Cognitunes developers win SXSW Hackathon with help from AlchemyAPI

Share this post:

I had the opportunity to ask some questions to the winning team of the SXSW Hackathon Championship last week. Their app, Cognitunes, was a favorite amongst judges for best Consumer Music app, winning $3,500 and attention of the developer community. Sean Cascketta, took me through their approach and how Watson was crucial in the product development.

Who is your team, and what is your background?

Our team is three people – Gus Ireland, Aaron Austin, and myself. Gus and Aaron are both software engineers, working at Rackspace and General Motors respectively. I am a 4th-year undergraduate Computer Science student at The University of Texas at Austin. I knew Gus beforehand since we are both members of a civic tech organization called Open Austin, a local brigade of Code for America. Gus and I met Aaron for the first time at the hackathon, but he was eager to work with us when he heard we were going to make a project with the Amazon Echo.

How did the idea come about?

When we found out that the Amazon Alexa team had demo Echo units available, we knew we wanted to make something using the slick voice interface of the Echo. Gus cleverly suggested that we put a twist on the Echo’s existing music player capabilities by automatically selecting music to play for a user based on their mood. Before we set the idea in stone, we looked for a way to run sentiment analysis beyond just positive or negative. That was when we talked to the IBM Watson team at the hackathon, and discovered that the Alchemy API was just what we needed.

How did you use Alchemy API?

Once we figured out how to use the Alexa Skills Kit API to transform a user’s speech into text, we needed a way to use that text to understand how a user was feeling. We used the Alchemy API’s Emotion Analysis service that takes a text sample and breaks down the emotions into five – fear, anger, joy, disgust, and sadness – each with their own score from 0 to 1, depending on the perceived strength of the emotion. We then used the emotion with the highest score in order to determine what type of music to play.

What did the judges think?

We definitely got a strong positive response from the judges, especially some laughs when the Echo played “Don’t You Worry Child” by Swedish House Mafia in response to “I’m so mad that I had to wait in line for two hours yesterday”. Above everything else, our demo’s best quality was simplicity — all we used for our demo was an Amazon Echo. There was no other device or even a PowerPoint involved. It literally spoke for itself.

What’s next for you?

I can tell you that all of us are thrilled to dig deeper into the possibilities of the Amazon Alexa ecosystem. We believe the frictionless voice interface has immense market potential, especially with the population that has difficulty using existing applications on desktop and mobile applications. One thing that I would like to build is an Alexa skill utilizing Chef Watson. How cool would it be if you could tell the Echo what ingredients you have, and it replies with ingredient pairings or recipe suggestions from Chef Watson?

Check out Cognitunes on GitHub, and follow Sean on Twitter.

Add Comment
No Comments

Leave a Reply

Your email address will not be published.Required fields are marked *

More Watson stories

Meet the team from the IBM Cloud Garage at Think 2018

The Client Technical Engagement (CTE) team can help you accelerate your business outcomes. CTE has a premier location at the heart of the Think 2018 Cloud and Data campus -- on the expo floor at booth #660. We're bringing designers, developers, consultants, solution architects and technical luminaries to work with our clients on their cloud adoption and transformation journeys.

Continue reading

Meet the IBM Cloud Garage Method experts at Think 2018

Last week I highlighted dozens of sessions from the IBM Cloud Garage consultancy of cloud architects and solution engineers that you’ll want to remember when planning your agenda. In this blog post, I introduce four of my colleages from our team on the IBM Cloud Garage Method. They will be on the staff supporting the Think 2018 conference as presenters, lab leaders, and “Ask Me Anything” experts. Look for them and ask them about the updated Garage Method Field Guide and two new Guides!

Continue reading

Join us in the IBM Cloud Garage at Think 2018

Think 2018 will feature all of IBM’s essential technologies in one place, including Cloud and data, Blockchain, infrastructure, and AI. The IBM Cloud Garage consultancy of cloud architects and solution engineers will be there as presenters, lab instructors, and consultants in the Cloud and Data Campus. This post highlights their sessions and discussions to help you plan your agenda!

Continue reading