NYU-Poly Researchers Awarded DARPA Contract to Explore the Deep Web

deep web

Shutterstock.com

Researchers at the NYU Polytechnic School of Engineering are developing methods to explore hard-to-find information on the Web — both on the surface and on the deep Web, the realm not indexed by standard commercial search engines.

Juliana Freire, a professor in the Department of Computer Science and Engineering, has been awarded $3.6 million by the U.S. Defense Advanced Research Projects Agency as part of its Memex program, a "three-year research effort to develop software that will enable domain-specific indexing of open, public Web content and domain-specific search capabilities." DARPA's initial goal with Memex is to fight human trafficking, by tracking criminals' use of the Web to attract customers.

Freire and her colleagues, including Ari Juels from Cornell Tech and Torsten Suel, a professor in the NYU School of Engineering Department of Computer Science and Engineering, are "working on the design scalable techniques to address the shortcomings of traditional search engines for specific information needs," according to a press release. "Their research aims to make focused crawlers more usable and able to efficiently handle a wide range of search tasks, including adversarial crawling, which is needed for tasks that involve tracking criminal activities. Another important goal of their research is to enable the integration of crawling with search and data analysis in a transparent and reproducible fashion."

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • illustration of a futuristic building labeled "AI & Innovation," featuring circuit board patterns and an AI brain motif, surrounded by geometric trees and a simplified sky

    Cal Poly Pomona Launches AI and Innovation Center

    In an effort to advance AI innovation, foster community engagement, and prepare students for careers in STEM fields and business, California State Polytechnic University, Pomona has teamed up with AI, cloud, and advisory services provider Avanade to launch a new Avanade AI & Innovation Center.

  • black graduation cap with a glowing blue AI brain circuit symbol on top

    Report: AI Is a Must for Modern Learners

    A new report from VitalSource identifies a growing demand among learners for AI tools, declaring that "AI isn't just a nice-to-have; it's a must."

  • glowing shield hovers above a digital cloud platform with abstract data streams and cloud icons in the background

    Google to Acquire Cloud Security Firm Wiz

    Google has announced it will acquire cloud security startup Wiz. If completed, the acquisition — an all-cash deal valued at $32 billion — would mark the largest in Google's history.

  • digital dashboard featuring a shield icon, graphs, a world map, and network nodes

    IBM Introduces Agentic AI Governance and Security Platform

    IBM has launched a new software stack for enterprise IT teams tasked with managing the complex governance and security challenges posed by autonomous AI systems.