Hadoop cluster up and running in minutes!

Share this post:

Several months back we embarked on a mission, to create a new Hadoop-as-a-service built cloud-first with a goal for on-demand provisioning of multi-node Hadoop clusters in just a few mins. This effort has culminated in the form of a new service on IBM Bluemix: IBM BigInsights for Apache Hadoop for Bluemix: Basic. The Beta is now live!

What is IBM BigInsights for Apache Hadoop for Bluemix: Basic?

IBM BigInsights is an industry standard Apache Hadoop offering that offers powerful in-Hadoop bigdata & analytics features. IBM BigInsights for Apache Hadoop is a service on IBM Bluemix and available under two different service plans: Enterprise and Basic. The Basic service plan provides a nimble model for creating and using Hadoop clusters for analytics. Users have the ability to provision a Hadoop cluster within a few minutes. The clusters run on the IBM Open Platform with Apache Spark and Apache Hadoop v4.2. The Basic service plan also offers a cost effective pricing model with an instance-hour charge metric (free access during Beta)

What is so cool about IBM BigInsights for Apache Hadoop for Bluemix?

  • Simple yet powerful: In just a few clicks you could spin a multi-node hadoop cluster that is provisioned in just a few minutes. It is based on the IBM Open Platform with Apache Spark and Apache Hadoop v4.2. You could run Spark and map-reduce jobs using the SSH console, Oozie workflow or leverage Apache Hadoop REST APIs.
  • Truly Elastic: Ability to scale the cluster up/down at will. For the Beta, cluster size is limited to a max of 5 data nodes, this will be augmented when we GA the service.
  • Object Store Support: You could now run jobs against data on Bluemix ObjectStore or SoftLayer ObjectStore. With the ability to move data between HDFS and the ObjectStore, you could now back-up HDFS data to the ObjectStore.

For feedback/queries, please reply to this post or post your question on Stack Overflow with tags #ibm-bluemix and #biginsights. This is just the beginning, we look forward to hear from you for us to further improve the service!

More stories
May 7, 2019

We’ve Moved! The IBM Cloud Blog Has a New URL

In an effort better integrate the IBM Cloud Blog with the IBM Cloud web experience, we have migrated the blog to a new URL:

Continue reading

April 30, 2019

Introducing IBM Analytics Engine v1.2 and Announcing the Deprecation of IBM Analytics Engine v1.0

We are excited to inform you about the new version of IBM Analytics Engine v1.2 that will be available starting May 15, 2019. Along with this release, Analytics Engine v1.0 will be retired.

Continue reading

April 19, 2019

Reach Out to the IBM Cloud Development Teams on Slack

Get the help you need fast—directly from the IBM Cloud Development Teams and other users on Slack.

Continue reading