Carnegie Mellon and IBM Intro Open Platform To Help Blind Navigate

  • By Dian Schaffhauser
  • 11/05/15

A research project at Carnegie Mellon University is helping blind people navigate with the use of an iPhone app that directs them based on information picked up from nearby sensors. NavCog, which is expected to be made available in the iTunes Store soon, draws on Bluetooth beacons and cognitive technologies to inform users on campus about their surroundings by talking to them through the phone or vibrating. The user enters the destination, turns on voice navigation, follows directions and will be notified when he or she arrives.

A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing. The researchers are also investigating the use of computer vision to characterize the activities of people in the vicinity and ultrasonic technology to help identify locations more accurately inside and outside of buildings.
A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing.

The app is built on the Human-Scale Localization Platform (HULOP), an open source initiative introduced jointly by Carnegie Mellon and IBM as an environment upon which to build applications specifically for people who are visually impaired.

"To gain further independence and help improve the quality of life, ubiquitous connectivity across indoor and outdoor environments is necessary," said IBM Fellow Chieko Asakawa, a visiting faculty member at Carnegie Mellon who is blind herself. "I'm excited that this open platform will help accelerate the advancement of cognitive assistance research by giving developers opportunities to build various accessibility applications and test non-traditional technologies such as ultrasonic and advanced inertial sensors to assist navigation."

Asakawa's research is supported with an award from IBM's Open Collaborative Research program.

A video demonstrating the technology is available on YouTube.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • laptop displaying a phishing email icon inside a browser window on the screen

    Phishing Campaign Targets ED Grant Portal

    Threat researchers at cybersecurity company BforeAI have identified a phishing campaign spoofing the U.S. Department of Education's G5 grant management portal.

  • multiple computer monitors connected by glowing blue lines in a network grid

    Gartner Forecasts Increased Spending on Desktop as a Service as Cost Optimization, Sustainability Drive Adoption

    Gartner's 2025 Magic Quadrant for Desktop as a Service reveals that while secure remote access remains a key driver of DaaS adoption, a growing number of deployments now focus on broader efficiency goals.

  • stylized figures, resumes, a graduation cap, and a laptop interconnected with geometric shapes

    OpenAI to Launch AI-Powered Jobs Platform

    OpenAI announced it will launch an AI-powered hiring platform by mid-2026, directly competing with LinkedIn and Indeed in the professional networking and recruitment space. The company announced the initiative alongside an expanded certification program designed to verify AI skills for job seekers.

  • young man in a denim jacket scans his phone at a card reader outside a modern glass building

    Colleges Roll Out Mobile Credential Technology

    Allegion US has announced a partnership with Florida Institute of Technology (FIT) and Denison College, in conjunction with Transact + CBORD, to install mobile credential technologies campuswide. Implementing Mobile Student ID into Apple Wallet and Google Wallet will allow students access to campus facilities, amenities, and residence halls using just their phones.