The new world of Big Data, IBM, Hadoop and Oozie
Lennart 120000HHVT Visits (3011)
Silicon Valley is entering a new era of Big Data, Cloud, Mobile and Analytics. One key ingredient in this brave new world is Open Source and more precisely the collaboration between established companies like IBM with open Source initiatives like Apache Oozie, in the picture to the left.
IBM has a long history of supporting open source projects and is leveraqing open source products like Hadoop in its InfoSphere BigInsights.
Oozie is an open-source workflow engine to manage data processing jobs for Apache Hadoop. As Wikipedia put it, it is an extensible, scalable and data-aware service to orchestrate dependencies between jobs running on Hadoop (including HDFS, Pig and MapReduce).
IBM's Watson system also makes use of Open Source components like Hadoop, Lucene, UIMA and Wikipedia
The symbiosis between established IT companies, the Open Source movement and startup companies is leading to a massiv global innovation wave that is creating new technologies, new tools like Heroku, deploymenty platforms like GitHub and new global enviroments like the Cloud.
There are currently estimated to be around two billion people online. In a mere decade that number is expected to grow to six billion.
What six billion people can do with open source, social media, the cloud and mobile boggles the mind.