September 9, 2021 By Kevin Shen 2 min read

Put your focus back on analytics, get the insights to make your business successful and let IBM Analytics Engine manage all the infrastructure and cluster management details.

IBM Analytics Engine provides Hadoop and Spark environments that optimize the scaling of compute and storage by separating the two. The new Serverless Plan takes this optimization a step forward by offering a way for customers to get almost 100% utilization with Spark instances. To achieve this high utilization, Analytics Engine manages the provisioning and de-provisioning of Spark clusters to ensure resources are running when there is a submitted workload, saving time and costs.

Today, we’re seeing common cluster utilization for current Apache Spark users range from 20% to 60%, leaving a ton of compute resources on the table, sitting idle. Keeping these clusters provisioned and managed also takes up your team’s time and effort, with the potential for costly errors when estimating and sizing the appropriate resources for an analytics workload.

The new IBM Analytics Engine Serverless plan offers a consumption-based usage model to eliminate these challenges. Customers only pay for the compute resources they consume and only consume what they need.

IBM Analytics Engine Serverless helps make Spark easier to consume, and the new plan’s per-second billing helps users control costs. In addition to supporting the latest version of Apache Spark, Analytics Engine Serverless has persistent Spark customization within an instance, so users can bring their own libraries and override the default Spark configuration, with the ability to keep changes each time a new cluster is provisioned.

With add-ons built by IBM Research (such as geospatial toolkit, data skipping and Parquet modular encryption) and integration with IBM Cloud Object Storage, Watson Knowledge Catalog and Watson Studio, you can ramp up your analytics with fast cluster provisioning managed for you. As part of the IBM Cloud Pak® for Data, Analytics Engine works with the tools you already have to support every step in the data science value chain.

Get started

Only pay for what you use, manage less and put your focus back on the business and analytics.

Provision an IBM Analytics Engine Serverless plan instance here, and get $200 in IBM Cloud credit if this is your first time signing up.

Learn more about Analytics Engine here.

More from Analytics

In preview now: IBM watsonx BI Assistant is your AI-powered business analyst and advisor

3 min read - The business intelligence (BI) software market is projected to surge to USD 27.9 billion by 2027, yet only 30% of employees use these tools for decision-making. This gap between investment and usage highlights a significant missed opportunity. The primary hurdle in adopting BI tools is their complexity. Traditional BI tools, while powerful, are often too complex and slow for effective decision-making. Business decision-makers need insights tailored to their specific business contexts, not complex dashboards that are difficult to navigate. Organizations…

IBM unveils Data Product Hub to enable organization-wide data sharing and discovery

2 min read - Today, IBM announces Data Product Hub, a data sharing solution which will be generally available in June 2024 to help accelerate enterprises’ data-driven outcomes by streamlining data sharing between internal data producers and data consumers. Often, organizations want to derive value from their data but are hindered by it being inaccessible, sprawled across different sources and tools, and hard to interpret and consume. Current approaches to managing data requests require manual data transformation and delivery, which can be time-consuming and…

A new era in BI: Overcoming low adoption to make smart decisions accessible for all

5 min read - Organizations today are both empowered and overwhelmed by data. This paradox lies at the heart of modern business strategy: while there's an unprecedented amount of data available, unlocking actionable insights requires more than access to numbers. The push to enhance productivity, use resources wisely, and boost sustainability through data-driven decision-making is stronger than ever. Yet, the low adoption rates of business intelligence (BI) tools present a significant hurdle. According to Gartner, although the number of employees that use analytics and…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters