Carnegie Mellon and IBM Intro Open Platform To Help Blind Navigate

  • By Dian Schaffhauser
  • 11/05/15

A research project at Carnegie Mellon University is helping blind people navigate with the use of an iPhone app that directs them based on information picked up from nearby sensors. NavCog, which is expected to be made available in the iTunes Store soon, draws on Bluetooth beacons and cognitive technologies to inform users on campus about their surroundings by talking to them through the phone or vibrating. The user enters the destination, turns on voice navigation, follows directions and will be notified when he or she arrives.

A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing. The researchers are also investigating the use of computer vision to characterize the activities of people in the vicinity and ultrasonic technology to help identify locations more accurately inside and outside of buildings.
A separate function under development performs facial recognition to help the user identify who is approaching, friends or strangers, and what kinds of expressions they're showing.

The app is built on the Human-Scale Localization Platform (HULOP), an open source initiative introduced jointly by Carnegie Mellon and IBM as an environment upon which to build applications specifically for people who are visually impaired.

"To gain further independence and help improve the quality of life, ubiquitous connectivity across indoor and outdoor environments is necessary," said IBM Fellow Chieko Asakawa, a visiting faculty member at Carnegie Mellon who is blind herself. "I'm excited that this open platform will help accelerate the advancement of cognitive assistance research by giving developers opportunities to build various accessibility applications and test non-traditional technologies such as ultrasonic and advanced inertial sensors to assist navigation."

Asakawa's research is supported with an award from IBM's Open Collaborative Research program.

A video demonstrating the technology is available on YouTube.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • glowing brain, connected circuits, and abstract representations of a book and graduation cap on a light gray gradient background

    Snowflake Launches Program to Upskill 100,000 People in Data and AI

    Cloud data platform Snowflake is embarking on an effort to train and certify more than 100,000 users on its AI Data Cloud by 2027. The One Million Minds + One Platform program will provide Snowflake-delivered courses, training materials, and free access to Snowflake software, at no cost to learners.

  • two abstract humanoid figures made of interconnected lines and polygons, glowing slightly against a dark gradient background

    Microsoft Introduces Copilot Chat Agents for Education

    Microsoft recently announced Microsoft 365 Copilot Chat, a new pay-as-you-go offering that adds AI agents to its existing free chat tool for Microsoft 365 education customers.

  • hand touching glowing connected dots

    Registration Now Open for Tech Tactics in Education: Thriving in the Age of AI

    Tech Tactics in Education has officially opened registration for its May 7 virtual conference on "Thriving in the Age of AI." The annual event, brought to you by the producers of Campus Technology and THE Journal, offers hands-on learning and interactive discussions on the most critical technology issues and practices across K–12 and higher education.

  • Three cubes of noticeably increasing sizes are arranged in a straight row on a subtle abstract background

    A Sense of Scale

    Gardner Campbell explores the notion of scale in education and shares some of his own experience "playing with scale" — scaling up and/or scaling down — in an English course at VCU.