November 19, 2020 By Alan Drummer 4 min read

According to projections from IDC, 80% of worldwide data will be unstructured by 2025.[1] Even though most enterprises already use data warehouses to analyze structured data, more are now turning to data lakes to leverage unstructured and semi-structed data in its native format. This includes the growing volume of streaming audio and video, social media, and clickstream, sensor and log data.

Data lakes bring organizations new opportunities by providing access to a greater variety and volume of data that can fuel more accurate analytic predictions and models. They also deliver rich, actionable insights by enabling organizations to find interesting relationships, trends, patterns and anomalies that wouldn’t be visible otherwise.

A Ventana research study showed that among enterprises with a data lake:

41% reported gains in competitive advantage
37% noted lowered costs
35% enjoyed improved customer experiences
33% believed it helped them respond better to opportunities and threats
28% revealed an increase in sales

Harness more data for better, data-driven decisions

Organizations in almost every industry are benefiting from data lakes. Let’s look at three industries where value has grown especially fast.

Financial services
Financial firms are using the ability to organize and accommodate unstructured data to include location, IoT, sensor, clickstream and social media data in their analytics. As a result, they’re able to deliver personalized insurance offerings, fight fraud more accurately, and gain 360-degree customer views. Read the report and watch the webinar to learn how they’re getting results like these:

  • 300% higher conversion rate
  • 30% fewer fraud incidents
  • Nearly USD 4 million reduction in expenditure
  • 90% quicker time-to-value for big data analytics

Read TechTarget’s assessment of these financial services accomplishments in the report: It’s a new era in advanced analytics and AI.

Watch the webinar on how global bank ING accelerated time to market for new products and shortened the selling process from years to months.

Healthcare firms depend on unstructured data such as doctors’ notes, X-rays, CT scans and research articles that empower front-line caregivers with real-time data and predictions. Results include:

  • 25% possible annual savings[2]
  • 31% reduction in 30-day readmission for certain patients[3]
  • USD 500,000 savings per year[4]

Read TechTarget’s Welcome to the healthcare revolution to learn more.

Communication service providers
Communication service providers are analyzing video feeds, clickstreams and third-party data to predict and prevent churn, optimize networks, and detect fraud in real time. Results include:

  • 350% more fraud incidents discovered[5]
  • Up to 20% revenue loss reduction[6]
  • 5% – 10% reduction in customer churn[7]

Read TechTarget’s Data Analytics and AI are empowering transformation report to learn more about these advancements.

What elements make a data lake successful?

Governance is essential for a data lake to succeed. Without it, a data lake can quickly turn into an unmanageable data swamp in which users can’t find, trust, or use the data they need.

A governed data lake contains clean, trusted data from structured and unstructured sources that can easily be found, accessed, managed and protected. It enables self-service access to help users find relevant information through simple search interfaces.  Read the ebook “Governed data lakes for business insights” to explore the key building blocks of effectively delivering trusted data.

An enterprise data catalog is the foundation for data lake governance. A catalog organizes a data lake by automating data discovery, metadata generation, and the building of machine-learning-extracted business glossaries. It can also perform automated scanning and risk assessments of unstructured data, as well as track data lineage. Learn more about these capabilities when you read the ebook “Build a better data lake.”

AI-led automated data integration can efficiently cleanse and deliver trusted data anywhere, at any scale and complexity, on and across multicloud and hybrid cloud environments.

In-flight data quality and active metadata and policy enforcements help ensure trusted delivery to data lakes. Read how to save on data movement and storage costs and boost business productivity using IBM DataStage.

Having a single source for hardware, software, services and multivendor solutions can make it easier to build, manage, govern and secure the data lake. IBM provides that source. Learn more about the IBM and Cloudera partnership, with an ecosystem of offerings designed for faster analytics results at scale. See how freedom from vendor lock-in, enhanced self-service and optimized integration are some of the drivers that “provide unprecedented flexibility, choice and value for clients” in the race to implement AI insights. Read the analyst report on total value of ownership.

Start leveraging semi-structured and unstructured data today

When properly governed with an enterprise data catalog, and unified with data virtualization so data can be queried from a single source, a data lake can transform the fast-growing volume of new data types from a burden into a benefit that helps fuel new and actionable insights.

Over the next few years, as semi-structured and unstructured data become as much as 80% of the world’s information, companies that can include these types of data as they look for relationships, trends, patterns, and anomalies will have a growing advantage over those who can’t. To get started, read this ebook on how to build a better data lake.

[1] Timothy King, 80 Percent of Your Data Will Be Unstructured in Five Years, Data Management Solutions Review, March 28, 2019. Accessed November 24, 2020.

[2] Sabyasachi Dash et. al., Big data in healthcare: management, analysis and future prospects. SpringOpen, June 19, 2019. Accessed November 19, 2020.

[3] Marina Turea, Ultimate Guide to Big Data in Healthcare, Healthcare Weekly, September 26, 2020. Accessed November 19, 2020.

[4] Ibid.

[5] Communication Service Providers: Data Analytics and AI Are Empower Transformation, TechTarget Custom Media. Accessed November 24, 2020.

[6] Cloudera, Reducing Revenue Loss from Fraud by up to 20 Percent, Accessed November 19, 2020.

[7] Ibid.

Was this article helpful?

More from Cloud

Announcing Dizzion Desktop as a Service for IBM Virtual Private Cloud (VPC)

2 min read - For more than four years, Dizzion and IBM Cloud® have strategically partnered to deliver incredible digital workspace experiences to our clients. We are excited to announce that Dizzion has expanded their Desktop as a Service (DaaS) offering to now support IBM Cloud Virtual Private Cloud (VPC). Powered by Frame, Dizzion’s cloud-native DaaS platform, clients can now deploy their Windows and Linux® virtual desktops and applications on IBM Cloud VPC and enjoy fast, dynamic, infrastructure provisioning and a true consumption-based model.…

Microcontrollers vs. microprocessors: What’s the difference?

6 min read - Microcontroller units (MCUs) and microprocessor units (MPUs) are two kinds of integrated circuits that, while similar in certain ways, are very different in many others. Replacing antiquated multi-component central processing units (CPUs) with separate logic units, these single-chip processors are both extremely valuable in the continued development of computing technology. However, microcontrollers and microprocessors differ significantly in component structure, chip architecture, performance capabilities and application. The key difference between these two units is that microcontrollers combine all the necessary elements…

Seven top central processing unit (CPU) use cases

7 min read - The central processing unit (CPU) is the computer’s brain, assigning and processing tasks and managing essential operational functions. Computers have been so seamlessly integrated with modern life that sometimes we’re not even aware of how many CPUs are in use around the world. It’s a staggering amount—so many CPUs that a conclusive figure can only be approximated. How many CPUs are now in use? It’s been estimated that there may be as many as 200 billion CPU cores (or more)…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters