By Torsten Steinbach 2 min read
March 18, 2021

IBM Cloud provides a cloud native data lake platform, which is unique in its commitment to a serverless consumption model. 

You can ingest, store, prepare, optimize and analyze your data in a serverless manner that scales resources fully transparently and exposes a fair pay-as-you-go cost model end-to-end. We provided a good introduction at the SubSurface WINTER 2021 Cloud Data Lake conference a few weeks ago.

Dremio connector to IBM Cloud Data Lake

Dremio is a very popular and open data lake engine to interactively explore, curate and consume data lake data, so it makes sense to use Dremio with IBM Cloud Data LakeIBM’s Cloud Data Lake platform.

We are happy to announce the availability of a new Dremio connector to IBM Cloud Data Lake. It enables Dremio to connect to IBM Cloud Data Lake services, push down SQL operations and retrieve results for processing into the Dremio engine. According to our commitment to open stacks, we have also made the connector itself available as open source.

In the documentation of the connector, you’ll find few simple steps on how you can optionally deploy and run Dremio itself right in IBM Cloud on top of the IBM Cloud Kubernetes Service. 

This way, you can build data lake solutions with an open, interactive user experience on top of a fully serverless data lake foundation that scales seamlessly and fairly along with your workload and data demands.

Learn more about IBM Cloud SQL Query.

Categories

Analytics  |  Announcements  |  Cloud  |  Open source  |  open-source  | 
Torsten Steinbach
Distinguished Engineer & CTO, Big Data in Cloud

More from Analytics
September 19, 2023

Data science vs data analytics: Unpacking the differences

5 min read - Though you may encounter the terms “data science” and “data analytics” being used interchangeably in conversations or online, they refer to two distinctly different concepts. Data science is an area of expertise that combines many disciplines such as mathematics, computer science, software engineering and statistics. It focuses on data collection and management of large-scale structured and unstructured data for various academic and business applications. Meanwhile, data analytics is the act of examining datasets to extract value and find answers to…

September 6, 2023

Financial planning & budgeting: Navigating the Budgeting Paradox

5 min read - Budgeting, an essential pillar of financial planning for organizations, often presents a unique dilemma known as the “Budgeting Paradox.” Ideally, a budget should give the most accurate and timely idea of anticipated revenues and expenses. However, the traditional budgeting process, in its pursuit of precision and consensus, can take several months. By the time the budget is finalized and approved, it might already be outdated.In today's rapid pace of change and unpredictability, the conventional budgeting process is coming under scrutiny.It's…

August 28, 2023

How Macmillan Publishers authored success using IBM Cognos Analytics

5 min read - Macmillan Publishers is a global publishing company and one of the “Big Five” English language publishers. If you're a reader, chances are good you've read a book from Macmillan. They published many perennial favorites including Kristin Hannah’s The Nightingale, Bill Martin’s Brown Bear, Brown Bear, what do you see? and some of the more recent bestsellers such as The Silent Patient by Alex Michaelides, Identity by Nora Roberts and Razorblade Tears by S. A. Cosby. It’s no wonder then that Macmillan…

August 11, 2023

MLOps and the evolution of data science

7 min read - The advancement of computing power over recent decades has led to an explosion of digital data, from traffic cameras monitoring commuter habits to smart refrigerators revealing how and when the average family eats. Both computer scientists and business leaders have taken note of the potential of the data. The information can deepen our understanding of how our world works—and help create better and “smarter” products. Machine learning (ML), a subset of artificial intelligence (AI), is an important piece of data-driven…