Health and medicine

The cognitive guide

Share this post:

This year’s World of Watson in Las Vegas brought together companies from around the world already taking advantage of cognitive computing in the  Cognitive Concourse. Among them, Carnegie Mellon University showcased their app to support the visually impaired. I met with Dragan Ahmetoric, a postdoctoral fellow of the Robotics Institute, to hear about an exciting new app to help the visually impaired.

Cognitive capabilities guide the visually impaired

A cognitive guide for the visually impaired

Dragan and a team of students at Carnegie Mellon have worked on ‘NavCog’, a turn-by-turn smartphone navigation assistant for the visually impaired or blind. Bluetooth beacons are placed within an environment. A smart-phone app picks up the data from the beacons to orientate a user within their environment. The smartphone can work out where it is and offer ‘turn left in x paces’ type guidance with accuracy within one meter. For users of the app more familiar with a guide stick, one meter would be a comfortable distance to work within.

Step by step instructions guide the way

A second feature of the app is that it can ‘see’ its environment. In the video above, you can see an example of a set of shelves stacked with cereal. A user could visit a store and use a voice command to look for cereal. The app would know where the cereal was located and guide the user there with voice instructions.

An app that ‘sees’ what’s on shelves

Once in front of the shelf, the app can also guide the user to specific items on that shelf. The app then goes further to use the camera to ‘look’ at an individual box of cereal and give the user a lot of information about the contents. A cognitive capability that will be extremely useful for the visually impaired.

You can find out more about this, and other companies using cognitive computing at the World of Watson Cognitive Concourse site.

More SaaS stories

How artificial intelligence is reshaping the high-tech industry

Written by Grant Bodley | November 29, 2018 | Blog, Electronics

It’s ironic that some companies in the high-tech industry making transformative electronics need to reinvent themselves to have a successful future. They don’t have to start over. But they do need to consider how they will transform their products, services and businesses to answer consumer demand and overcome disruptive market forces. There are two fundamental ...read more


The Get Connected quiz: are you ready to transform your business?

Written by Chris O'Connor | October 30, 2018 | Blog

I hope you’ve gotten connected with me these last several weeks. I was talking to a colleague about why I wrote these. And it really comes down to one thing: IoT is taking place all around us. Are you and your company participating in the digital transformation, and impacting the physical world? Or are you ...read more


There’s something for everybody at the Agile Engineering Summit!

Written by Steve Shoaf | October 5, 2018 | Blog

On October 15-17 in Washington, DC, IBM is hosting its 5th event focused on software and systems engineering. Known in the past as IoT Continuous Engineering (ICE) and as Continuous Engineering (CE) Summit, this event is now called Agile Engineering Summit. It will provide opportunities to find out how federal, automotive, industrial, A&D, healthcare and electronics ...read more