Steering a Driving Android Phone over the Web via Speech Recognition in IBM Bluemix

Share this post:

My colleagues Bryan Boyd and Mark VanderWiele have created a nice demo where you can drive smartphones using Sphero balls. I’ve modified the sample slightly so that it also works for Android phones. Watch the video to see how to steer a driving smartphone via IBM Bluemix, the Internet of Things and cognitive services from IBM Watson.

Here are the details:

  • The phone is carried by a Sphero ball and a chariot.
  • The phone communicates with the ball via bluetooth protocol. The native Android app uses the Sphero Android SDK.
  • The phone communicates with the Internet of Things service in Bluemix via a Java MQTT library.
  • A Node-RED flow is used to send commands to the native app either when certain URLs are invoked or certain Twitter tweets are sent.
  • For the speech recognition the sample of the Speech to Text service has been slightly modified to send the text to the Internet of Things service via MQTT from the client side JavaScript.
  • The Node-RED flow receives the spoken text via an Internet of Things input node. The first word of a text is used to interpret the command and then the same flow as previously is triggered.

This is a screenshot of the flow for incoming URL commands and the devices.

Flow for incoming URL commands

More stories
May 1, 2019

Two Tutorials: Plan, Create, and Update Deployment Environments with Terraform

Multiple environments are pretty common in a project when building a solution. They support the different phases of the development cycle and the slight differences between the environments, like capacity, networking, credentials, and log verbosity. These two tutorials will show you how to manage the environments with Terraform.

Continue reading

April 29, 2019

Transforming Customer Experiences with AI Services (Part 1)

This is an experience from a recent customer engagement on transcribing customer conversations using IBM Watson AI services.

Continue reading

April 26, 2019

Analyze Logs and Monitor the Health of a Kubernetes Application with LogDNA and Sysdig

This post is an excerpt from a tutorial that shows how the IBM Log Analysis with LogDNA service can be used to configure and access logs of a Kubernetes application that is deployed on IBM Cloud.

Continue reading