Video should soon represent up to 90% of all consumer internet traffic. This is a lot of information, often referred to as “dark data”, that is not simply searchable like a row in a database. In a previous post, I’ve looked at image tagging and face detection with IBM Watson Visual Recognition and Alchemy API. What if we could apply the same technologies to videos to make sense of these “dark data”?
That’s what I did, helped again by IBM Bluemix OpenWhisk and Watson services. The sample application, called Dark Vision, processes videos by extracting frames and tagging these frames independently.
Once all frames have been analyzed, a summary of the most frequent tags, building and faces is built for the video. The resulting tags and keywords could, for instance, be used to build a recommendation engine to suggest related videos or to display advertisements directly linked to the content of the video; alternatively, they could be used to improve search results. And as we can keep track of which tag appeared in which frame, we could also improve the viewer experience by skipping the video directly to the frame where a tag, or a face was first seen.
Check out this video to see the application in action:
Helped by cognitive technologies like Alchemy API and Watson Visual Recognition, we are able to automatically extract useful information from these videos without having to actually watch them. Combined with OpenWhisk, a cloud-first distributed event-based programming service, we built a system that can process these videos at scale without worrying about the infrastructure or the sizing of the system.
If you have feedback, suggestions, or questions about the app, please reach out to me on Twitter @L2FProd. If you want to see OpenWhisk running in IBM Bluemix, sign-up for the experimental Bluemix OpenWhisk.
In this blog post we discuss how Sematext integrates with IBM Bluemix Container Service to provide monitoring and logging visibility of your containerized applications, as they run in production. In the sections below, we demonstrate how to set up a Kubernetes cluster in Bluemix and how to set up Sematext in this cluster. IBM Cloud has monitoring and logging capabilities in the platform, but we know our customers operate in a multi-cloud or hybrid cloud environment and we are very excited to partner with Sematext, enabling operational consistency across those environments. We worked with Alen Komljen, an Automation Engineer from Sematext, to create the following content and perform the technology validation.
IBM Cloud private is an application platform for developing and managing on-premises, containerized applications. It is an integrated environment for managing containers that includes the container orchestrator Kubernetes, a private image repository, a management console, and monitoring frameworks.