User Experience

Invention and inclusion: a two-way approach

Share this post:

Patenting is my passion and inclusion is my responsibility as an inventor. We should always think about how we can include all of the population in the technology we create. Invention and inclusion work very well together, as they can work in both directions. Together, we can invent to improve lives and make this world a better place.

Map display for the visually impaired

It was a beautiful spring day when I found myself standing near a newly developed financial district in Beijing. I needed to find a bank. I was pleasantly surprised that there was a large street map embedded with braille. I carefully looked at street names and building names on the map and noticed that I needed to cross a few blocks and make some turns to get there. I took a picture of the map and then marched on. By the time I finally reached my destination, I realized how challenging it would have been for a vision-impaired user to do the same thing. It was almost impossible to remember all of the details to go from point A to point B independently in a busy district, even though the map had braille on it.

Braille Map in Display Kiosk in Beijing, China financial district.

I created a Map Display with Directions Generating and Download Facility patent to solve this challenge. This system is a for providing directions to a user. The system can assist a user in reaching a destination by converting the directions information into mobile device-based downloadable media. The approach includes collecting input data at a map display and generating directions for a person to use in navigating from the current location to the destination. The system can download the directions to a mobile device in text data format or voice data format. This way, the users can just carry the information with them on the mobile device and navigate to their destinations easily.

Once I started looking at the world through this lens, I had some breakthrough ideas in the name of inclusion. Here are a couple I’ve also patented.

Reading device usability enhancement system in the distractive environment

Remember the last time you were in the middle of listening to an important meeting recording but got interrupted? We often get distracted by things around us, such as picking up the phone or turning around to talk to somebody. We’re then tasked with the burden of reorienting ourselves and picking up where we left off in our work. This kind of distraction can be even more troublesome for people who use screen reader software to read the information for them. If distracted, the vision-impaired users have to start from the top of the page to have the information read to them all over again.

My patent Reading Device Usability can solve this kind of challenge, as the system can automatically pause the screen reader when it detects the user’s distraction level exceeds the normal threshold. The same invention system can be applied to any other reading device, which could benefit the general population. Instead of getting frustrated in a distractive environment, this invention can come in handy by automatically pausing the audio clip for you and resuming the play once you can start focusing on the task again.

Grasping sentiment on social media with assistive technology

Social networking sites have become deeply integrated parts of our lives. We use these tools to keep in touch with our friends and families and use the media to show the world what we are doing and what we are thinking. However, it has been challenging for screen reader software to express the same sentiment when it reads the text. I told myself that I really should come up with an invention to help everybody get the same sentiment information when navigating social networking websites. My patent Social Networking with Assistive Technology Device can be handy for this. This invention can analyze the content posted on a social networking website, and then uses sentiment analysis techniques to determine sentiments . The system retrieves a vocal characteristic corresponding to the derived sentiment. Text from the document is audibly read to the visually impaired user with a text to speech process that utilizes the retrieved vocal characteristic. The retrieved vocal characteristic then conveys the derived sentiment of the document to the visually impaired users.

I want to reflect on how much we should appreciate the fast growth of technology enabling us to communicate globally and work more efficiently. We should always think of inclusion when we create a new technology.  These were just a few patent examples where we achieve better results when taking inclusion into consideration.

More User Experience stories
By Erich Manser on May 13, 2019

IBM Celebrates Global Accessibility Awareness Day – May 16

On Thursday, May 16, IBM site locations and iX Design Studios across the U.S. will celebrate the eighth annual Global Accessibility Awareness Day (GAAD) –  a worldwide observation to raise awareness of digital access and inclusion issues for people with disabilities. As an IBMer with a disability, and a founding member of IBM’s Team Able, I am […]

Continue reading

By TJ Koines on September 11, 2018

Advancing the design of NavCog

Every day, over 2.5 million people travel in and out of airports[1]. While air traveling has become an integral part of our lives and despite efforts to provide entertainment, comfort, and assistance, airports cause stress and anxiety. In fact, a recent study found that about 80% of people feel tense when traveling through the airport[2]. […]

Continue reading

By Erich Manser on March 7, 2018

IBM Employees with Disabilities Volunteer Time to Create Accessible Technology

Who better to confirm the accessibility of solutions before they are released to market than people with disabilities? Being visually impaired, I rely considerably on magnification and altered colors to see what’s on my device screens. One day, not long ago, I sat in a room full of developers in a meeting and it was illuminating to […]

Continue reading