Skip to main content
Add as a preferred source on Google


NYU-Poly Researchers Awarded DARPA Contract to Explore the Deep Web

deep web

Shutterstock.com

Researchers at the NYU Polytechnic School of Engineering are developing methods to explore hard-to-find information on the Web — both on the surface and on the deep Web, the realm not indexed by standard commercial search engines.

Juliana Freire, a professor in the Department of Computer Science and Engineering, has been awarded $3.6 million by the U.S. Defense Advanced Research Projects Agency as part of its Memex program, a "three-year research effort to develop software that will enable domain-specific indexing of open, public Web content and domain-specific search capabilities." DARPA's initial goal with Memex is to fight human trafficking, by tracking criminals' use of the Web to attract customers.

Freire and her colleagues, including Ari Juels from Cornell Tech and Torsten Suel, a professor in the NYU School of Engineering Department of Computer Science and Engineering, are "working on the design scalable techniques to address the shortcomings of traditional search engines for specific information needs," according to a press release. "Their research aims to make focused crawlers more usable and able to efficiently handle a wide range of search tasks, including adversarial crawling, which is needed for tasks that involve tracking criminal activities. Another important goal of their research is to enable the integration of crawling with search and data analysis in a transparent and reproducible fashion."

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • abstract illustration of artificial intelligence

    CSU Shares AI Learnings in Systemwide Survey

    In a systemwide survey of more than 94,000 faculty, staff, and students, California State University recently documented widespread AI use across its 22 campuses.

  • AI logo near computer equipment

    White House Releases National Policy Framework for AI

    The White House has released a four-page AI policy framework aimed at setting a national approach to AI, with priorities including child safety, intellectual property protections, truth and accuracy guardrails, and worker training for an AI-driven economy.

  • Dana Brunson facilitates a roundtable discussion with research and higher education IT leaders

    Internet2: Closing the Access Gap for Research Cyberinfrastructure

    Internet2's Research Engagement Team brings CIOs and other campus technology leadership together with research computing and data facilitators, forming a community that enables research cyberinfrastructure at institutions of all types and sizes.

  • Silhouettes of business professionals stand against a blurred futuristic city skyline at night, with a glowing digital network data connection

    It's Time for Higher Ed to Get Serious About AI Strategy

    Without a coordinated strategy that involves multiple academic and administrative units across the entire campus, colleges risk wasting resources, duplicating efforts, and ultimately failing to deliver on the promise of deploying technology to improve learning and operations.