Cognitive

Introducing Watson to the world of music

Share this post:

Watson is a source of inspiration to many creative minds. It helps chefs at home and in top restaurants to cook exciting dishes, and it assists painters and dress designers in creating true works of art. Now Watson is expanding its expertise to the world of music: the system is being trained to work with musicians, helping them to write compositions unheard of before.

Watson Beat is a cloud-based app using cognitive technology. Machine learning and artificial intelligence expert Janani Mukundan, and Richard Daskas, a composer and professional musician, are collaborating on the project.

Together, they have taught Watson about the specifics of rhythm, pitch, and instrumentation, as well as the differences in genres. All of it combines in algorithms running through Watson’s neural network to help artists create a original compositions.

“Watson Beat knows what sounds good to us. And based on input, it knows, for example that if a user wants a ‘dark’ or ‘gloomy’ song, that it should use a minor key,” Janani said.

Listen and learn

Watson Beat then keeps learning from its users. In as few as eight bars or 15 seconds of input, it can churn out a multi-instrument, minutes-long track that can be adjusted according to the mood and genre any budding Beethoven chooses. Here is a sample of an original piece by Richard:

Richard only wrote it for, and played it on the piano. But he decided to amp it up – give it an up-tempo sound with a bass line, drum kit, and a Middle Eastern beat. With just the sample above, here is what Watson Beat banged out:

“Watson Beat can understand MIDI (file) inputs of entire songs – even multiple songs – or individual instruments. Or, like the sample above, it can comprehend live play. I plugged a keyboard into my laptop and ran the app as I played,” Richard said.

Richard determined the upbeat style of the song, as well as the variation of the additional instruments, by introducing perturbations into Watson Beat’s neural network. These adjustments, done via an app, tell the system how similar or different the collaborative composition should be, compared to the original. This sliding scale of cognitive computing influence can come in especially handy for those whose last piano lesson stopped with Mary Had a Little Lamb!

The sound of opportunity

Watson Beat, like its smart app-in-the-cloud brethren, collaborates. It can help a musician get over writer’s block or remove hidden biases in genre or style by introducing something quite literally unheard of before. It might also be used in a music therapy setting.

For now, Janani and Richard’s creation is still a proof of concept. Attendees at SXSW, Tribeca, and Moogfest had a first-hand opportunity to listen to and even try creating their own music. Longer term, the pair wants to offer Watson Beat as an app for the public.

Listen to more samples on our soundcloud playlist.

Want to know more to start solving real problems? Click here.

More Cognitive stories

How to turn the right mental knobs to change the way people (want to) work

Introduction Hi, I am Sarah Zheng, a cognitive business consultant at IBM in Amsterdam. In this role, I advise clients on how they can leverage the power of AI-technologies to improve their business processes. In this blog series, I want to give you my vision on why many projects where new technologies are introduced, fail […]

Continue reading

Tanmay meets Metis Montessori Lyceum

We are in the early days of the 4th industrial revolution, new developments such as robotics, nanotechnology, biotechnology, 3D printing, virtual reality and the Internet of Things will change every job. Some jobs will be superfluous but at the same time new jobs will come up. So far nothing new under the sun,  jobs have […]

Continue reading

Lexus Europe maakt de meest intuïtieve autoreclame ter wereld met IBM Watson

Volgens één van de grootste filmmakers aller tijden, Alfred Hitchcock, heb je slechts drie dingen nodig om een geweldige film te maken “… het script, het script en het script.” Maar wat gebeurt er als je een met een Oscar bekroonde regisseur een script geeft dat helemaal door artificiële intelligentie is geschreven? Het resultaat is […]

Continue reading