Skip to main content
Add as a preferred source on Google


NYU-Poly Researchers Awarded DARPA Contract to Explore the Deep Web

deep web

Shutterstock.com

Researchers at the NYU Polytechnic School of Engineering are developing methods to explore hard-to-find information on the Web — both on the surface and on the deep Web, the realm not indexed by standard commercial search engines.

Juliana Freire, a professor in the Department of Computer Science and Engineering, has been awarded $3.6 million by the U.S. Defense Advanced Research Projects Agency as part of its Memex program, a "three-year research effort to develop software that will enable domain-specific indexing of open, public Web content and domain-specific search capabilities." DARPA's initial goal with Memex is to fight human trafficking, by tracking criminals' use of the Web to attract customers.

Freire and her colleagues, including Ari Juels from Cornell Tech and Torsten Suel, a professor in the NYU School of Engineering Department of Computer Science and Engineering, are "working on the design scalable techniques to address the shortcomings of traditional search engines for specific information needs," according to a press release. "Their research aims to make focused crawlers more usable and able to efficiently handle a wide range of search tasks, including adversarial crawling, which is needed for tasks that involve tracking criminal activities. Another important goal of their research is to enable the integration of crawling with search and data analysis in a transparent and reproducible fashion."

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • Digital cyberspace with particles and Digital data

    Report: AI Is Moving Faster than Data Trust

    AI agents are already in use or pilot at most organizations, but data visibility, governance and precision recovery capabilities have not kept pace, according to Veeam's new Data & AI Trust Gap report.

  • Glowing route lines merging into single gold pathway

    Microsoft Merges Copilot Apps Into a Single User Experience

    Microsoft recently announced it is consolidating its consumer Copilot app and Microsoft 365 Copilot app into a single destination, addressing a fragmented product strategy that has required users to navigate separate applications for AI chat and productivity tools.

  • CIS Sandbox Tutor Eli Blouin at Bentley University imagines a future technology learning partner that supports curiosity, critical thinking, feedback, and personalized learning.

    Student Voices: Technology as a Future Learning Partner

    A data analytics and marketing major at Bentley University and a distinguished lecturer at the university explore the future of "technology learning partners" — technologies that participate in the learning process by asking questions and giving feedback, not just information search results.

  • Silhouettes of business professionals stand against a blurred futuristic city skyline at night, with a glowing digital network data connection

    It's Time for Higher Ed to Get Serious About AI Strategy

    Without a coordinated strategy that involves multiple academic and administrative units across the entire campus, colleges risk wasting resources, duplicating efforts, and ultimately failing to deliver on the promise of deploying technology to improve learning and operations.