Skip to main content
Add as a preferred source on Google


NYU-Poly Researchers Awarded DARPA Contract to Explore the Deep Web

deep web

Shutterstock.com

Researchers at the NYU Polytechnic School of Engineering are developing methods to explore hard-to-find information on the Web — both on the surface and on the deep Web, the realm not indexed by standard commercial search engines.

Juliana Freire, a professor in the Department of Computer Science and Engineering, has been awarded $3.6 million by the U.S. Defense Advanced Research Projects Agency as part of its Memex program, a "three-year research effort to develop software that will enable domain-specific indexing of open, public Web content and domain-specific search capabilities." DARPA's initial goal with Memex is to fight human trafficking, by tracking criminals' use of the Web to attract customers.

Freire and her colleagues, including Ari Juels from Cornell Tech and Torsten Suel, a professor in the NYU School of Engineering Department of Computer Science and Engineering, are "working on the design scalable techniques to address the shortcomings of traditional search engines for specific information needs," according to a press release. "Their research aims to make focused crawlers more usable and able to efficiently handle a wide range of search tasks, including adversarial crawling, which is needed for tasks that involve tracking criminal activities. Another important goal of their research is to enable the integration of crawling with search and data analysis in a transparent and reproducible fashion."

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • cloud computing circuit board background

    Report: Cloud Crime on the Rise as Attackers Exploit Trust

    CrowdStrike's 2026 Threat Hunting Report traces a multiyear shift from conventional intrusions toward attacks that exploit trusted identities, cloud services, AI systems and software dependencies.

  • Glowing route lines merging into single gold pathway

    Microsoft Merges Copilot Apps Into a Single User Experience

    Microsoft recently announced it is consolidating its consumer Copilot app and Microsoft 365 Copilot app into a single destination, addressing a fragmented product strategy that has required users to navigate separate applications for AI chat and productivity tools.

  • Abstract Network Connection Structure with Glowing Nodes and Lines on Dark Background

    Rubrik, CrowdStrike Expand Integration to Speed Identity Recovery

    Cybersecurity companies Rubrik and CrowdStrike have announced an expanded identity-security integration intended to move compromised identity environments from threat detection through clean recovery with less manual intervention.

  • Abstract neural network 3D illustration

    Intel® AI EmpowerED: The AI-Ready Campus, Delivered

    Artificial intelligence is transforming higher education, prompting institutions to rethink how they manage infrastructure, security, governance, and workforce readiness. Successful adoption requires a strategic, institution-wide approach that aligns AI initiatives with educational goals, faculty enablement, and scalable operational frameworks.