Skip to main content
Add as a preferred source on Google


Carnegie Mellon and IBM Intro Open Platform To Help Blind Navigate

  • By Dian Schaffhauser
  • 11/05/15

A research project at Carnegie Mellon University is helping blind people navigate with the use of an iPhone app that directs them based on information picked up from nearby sensors. NavCog, which is expected to be made available in the iTunes Store soon, draws on Bluetooth beacons and cognitive technologies to inform users on campus about their surroundings by talking to them through the phone or vibrating. The user enters the destination, turns on voice navigation, follows directions and will be notified when he or she arrives.

A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing. The researchers are also investigating the use of computer vision to characterize the activities of people in the vicinity and ultrasonic technology to help identify locations more accurately inside and outside of buildings.
A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing.

The app is built on the Human-Scale Localization Platform (HULOP), an open source initiative introduced jointly by Carnegie Mellon and IBM as an environment upon which to build applications specifically for people who are visually impaired.

"To gain further independence and help improve the quality of life, ubiquitous connectivity across indoor and outdoor environments is necessary," said IBM Fellow Chieko Asakawa, a visiting faculty member at Carnegie Mellon who is blind herself. "I'm excited that this open platform will help accelerate the advancement of cognitive assistance research by giving developers opportunities to build various accessibility applications and test non-traditional technologies such as ultrasonic and advanced inertial sensors to assist navigation."

Asakawa's research is supported with an award from IBM's Open Collaborative Research program.

A video demonstrating the technology is available on YouTube.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • abstract smartphone translucent screen displaying AI interface

    Apple Introduces Redesigned Siri AI

    At its recent Worldwide Developers Conference, Apple introduced Siri AI, a redesigned version of its voice assistant that Apple describes in its own announcement as "a profoundly more capable and personal assistant." The update is intended to make Siri more conversational, more context-aware, and more useful across iPhone, iPad, Mac, Apple Watch, and Vision Pro.

  • blue wooden cubes block texture abstract background

    Gartner Estimates Worldwide IT Spending at $6.31T for 2026

    Gartner recently forecast that worldwide IT spending will total $6.31 trillion in 2026, a 13.5% increase from 2025. Sectors experiencing the largest growth include data center systems, software, and IT services.

  • people as silhouettes on a glowing network grid

    Human-Centered Workforce Development in an Age of Advanced Technology

    Marc Booker, vice provost of strategy at the University of Phoenix, examines how to recognize and promote human-centered workforce development in higher education.

  • Dana Brunson facilitates a roundtable discussion with research and higher education IT leaders

    Internet2: Closing the Access Gap for Research Cyberinfrastructure

    Internet2's Research Engagement Team brings CIOs and other campus technology leadership together with research computing and data facilitators, forming a community that enables research cyberinfrastructure at institutions of all types and sizes.