Discovery and Exploration

What’s in a bad user review? Maybe your next breakthrough

Share this post:

Key Points:
– Not all reviews are created equal. In fact, some reviews, even negative feedback, can reveal insights and better customer experiences.
– Manually reading, categorizing and prioritizing customer feedback can be time-consuming and costly. Fortunately, IBM Watson doesn’t have these constraints.
– Use Watson Discovery Service to analyze reviews with three stars or less and positive sentiment to uncover golden nuggets of actionable insights buried in the feedback.

Build an app that analyzes reviews


Think you know your customers and what they want from your app? You might be surprised. Gain new insights from customer reviews.

There’s no question that customer reviews are valuable. Especially when it comes to mobile applications, where one review with less than three stars can dramatically reduce the number of downloads and stall adoption.

But, not all reviews are created equal. Some negative reviews can reveal insights that boost your app’s popularity or at least deliver a great experience for your customers.

While star ratings provide an overall score for an application, it isn’t enough. The trick is distilling meaningful feedback from reviews including both positive and negative feedback. In IBM’s work with thousands of clients, we’ve found that regular app users can be the harshest critics, and one of the best sources for ways to improve the customer experience.

Taking a closer look at customer reviews

Imagine a fan goes to see their favorite band in concert but leaves disappointed because the venue had poor acoustics. Now that fan might give the band a three-star rating along with this review: “I love this band but the sound was too loud!”

We see the fan uses the word “love” and this provides a clue. In IBM Watson terms, this is called “positive sentiment” and it’s a powerful concept. Positive sentiment can be a great indicator of which reviews could contain useful and actionable information. In this case, it’s easy to identify the problem, which was a bad venue. The band can quickly remedy the situation by selecting new venues with better sound and improve the fan experience.

Conversely, reviews like “I hate all music by this band” are judged to have negative sentiment and are less valuable. While bands want everyone to love their music, it rarely happens. In this case, there isn’t much that can be done to turn around a concert-goer with such strong negative feelings.

The concert-goer scenario is just one example of how developers can use Discovery Service to uncover a goldmine of ideas for improvements that will delight users. Similar nuggets can be found in almost any customer feedback or product reviews you can imagine, for example:

  • “I love this book but I wasn’t able to relate to the new character introduced into the series.”
  • “This is my favorite restaurant for family celebrations. The last time we went, the signature dish was no longer on the menu.”
  • “I love my new car but the driver-side cup holder is too far back and out of reach.”

Of course, evaluating a few reviews manually doesn’t take long but what if you have thousands of customer reviews? Reading, categorizing and prioritizing them all can be time-consuming and costly. Fortunately, Discovery can automate this entire process.

How it all works

Our Mobile Innovations team used Discovery to build a simple, sample iOS app to evaluate recent reviews of the top 100 free apps in the Apple app store.. As part of the analysis, we directed the service to calculate and display three insights for each of the reviewed apps, which developers could then use to identify and prioritize next steps:

  1. Sentiment – The overall sentiment of all reviews for the app, which is measured by assigning a value from one to ten to each review and then averaging the total. Then, the app is assigned a letter grade from A to F based on the overall average sentiment score. The higher the grade, the more positive reviews for that app; the lower the grade, the more negative reviews.
  2. Keywords – A list of the most common words found in an app’s reviews. Keywords often map to a feature or concept in the app including how often each keyword is mentioned in positive, negative or neutral reviews, which makes it easy to identify popular or polarizing app features.
  3. Opportunities – A list of three-star or lower reviews that also include positive sentiment, which an app developer can then analyze to discover opportunities for improving their app based on customer feedback.

See for yourself the types of insights that had been hidden in the reviews and which became visible with Discovery.


IBM is making it easier to analyze relevant customer reviews and uncover actionable intelligence buried in the data. Use this tutorial and get the code to create your own instance.

Learn more about IBM Watson Discovery Service

Start your free trial of Watson Discovery Service

Add Comment

Leave a Reply

Your email address will not be published.Required fields are marked *

Essay writer

The concert-goer scenario is a wonderful example….Great article there very informative


Abhay Singh

You made it sound so easy here. Way to go.

More Discovery and Exploration Stories
September 11, 2017

Hiring Heroes: How Woodside Energy works with IBM Watson

Key points: – Woodside Energy has been working with Watson to make decades of expertise available to its engineers. – Watson ingested the equivalent of 600,000 pages of information, or 30 years of knowledge – Watson helped reduce the time spent searching for expert knowledge by 75% Learn more   Woodside Energy is Australia’s largest […]

Continue reading

August 14, 2017

How Watson AI is helping companies stay ahead of hackers and cybersecurity attacks

Cybercrime is projected to cause $6 trillion in damages by 2021. There is no way to manually read and analyze the huge volumes of unstructured data that security analysts need to process. Watson's AI allows systems to continuously learn by constantly analyzing billions of data points to detect patterns and even predict attacks before they occur, helping clients analyze threats up to 50% faster.

Continue reading

August 4, 2017

AI is the future of cybersecurity – How Watson helps detect threats faster and better protect your organization

Not having complete context and a holistic, real-time view of cyber threats puts an organization at a huge risk. Global ransomware attacks will exceed $5 billion in damages this year, up from $325 million in 2015. Learn how AI is being used to transform the cybersecurity industry and help analysts identity threats and resolve them faster than ever before.

Continue reading