What is Analytics Engine?

IBM Analytics Engine provides an architecture for Hadoop clusters that decouples the compute and storage tiers. Instead of a permanent cluster formed of dual-purpose nodes, the Analytics Engine allows users to store data in an object storage layer such as IBM Cloud Object Storage and spins up clusters of compute notes when needed. Separating compute from storage helps to transform the flexibility, scalability and maintainability of big data analytics platforms.  

Read the white paper (PDF, 280 KB)  

Analytics Engine features

Leverage open source power

Build on an ODPi compliant stack with pioneering data science tools with the broader Apache Hadoop and Apache Spark ecosystem.

Spin up and scale on demand

Define clusters based on your application's requirement. Choose the appropriate software pack, version, and size of the cluster. Use as long as required and delete as soon as application finishes jobs.

Configure the environment

Configure clusters with third-party analytics libraries and packages. Deploy workloads from IBM Cloud services like machine learning.

Analytics Engine benefits

Compute and storage are no longer bound

Spin up compute-only clusters on demand. Because no data is stored in the cluster, clusters never need to be upgraded.

I/O-heavy clusters are more cost-effective

Provision more IBM Cloud Object Storage (or other data stores) on demand with no extra costs for compute cycles not used.

Clusters are more elastic

Adding and removing data nodes based on live demand is possible via REST APIs. Also, overhead costs remain low because there is no data stored in the compute cluster.

Security is more cost-effective

Using a multilayered approach significantly simplifies the individual cluster security implementation, while enabling access management at a more granular level.

Vendor lock-in is avoided

Clusters are spun up to meet the needs of the job versus forcing jobs to conform to a single software package/version. Multiple different versions of software can be run in different clusters.

Analytics Engine versions

IBM Analytics Engine

Flexible framework to develop Hadoop and Spark analytics applications

Get started on Analytics Engine in minutes

Get the combined service that provides an environment for developing and deploying advanced analytics applications