Big Data

Automate big decisions in a big data world

Share this post:

Big data big decisionsNo longer only the domain of science fiction, artificial intelligence (AI) is poised to impact everything from how steel is produced to how banks recommend financial products and even to how farmers grow lettuce. It could even change how people move around cities and do business.

At its core, AI can be defined as a set of technologies that enable computing systems to sense, comprehend and act. Within 10 years, AI and robotics are expected to make a creative disruption impact estimated of between $14 trillion and $33 trillion dollars in cost reductions across manufacturing and healthcare, enabled by the automation of knowledge work, according to a Bank of America Merrill Lynch report.

Rule engine and expert systems have been essential components of symbolic artificial intelligence for decades. How, then, can this AI technology complement machine learning today? How can rules be applied on big data to augment enterprises’ digital capabilities while bringing transparency to decision making?

Business rules provided by IBM Operational Decision Manager (ODM) have proven successful in implementing eligibility, pricing and fraud detection systems. Whether an organization’s systems are running on the cloud or on premises, transactionally or in a batch, its rule engine can run decision logic in few milliseconds and at scale in a cluster. With a governed approach, business users and developers can validate a new version of a policy and inject it dynamically in running systems without stopping or repackaging them.

Traditional business rule applications process records a few megabytes of data at a time. As solutions move to big data, rules may be applied to terabytes of data. To this end, the integration of ODM with Apache Spark and Hadoop MapReduce can help scale business rules solutions to the world of big data, and combine them with machine learning algorithms.

Benefits of a successful big decision program include the following:

  • Ability for business users to author, test, simulate and deploy corporate decision automation and management services
  • Collaboration across business users, developers and operations teams in a governance schema
  • Continuous and fast decision automation and service delivery
  • Agility in the change of automated corporate policies, including emergency fixes to production environments to respond to new situations, for example, fraud detection
  • Scalability of the decision automation enabled by open source cluster technology including Hadoop and Spark
  • Possibility of the convergence of machine learning and rule algorithms in the same cluster and the same data lake
  • Auditability to justify automated decisions

Any organization, regardless of size, can employ a rules engine and utilize big data to achieve high performance levels and automate its policies to deliver repeatable and transparent decisions also reducing costs. The world of big decisions is agile and fast-paced and enables massive simulations and production of AI workloads with potential combinations of Watson services and Data Science Experience.

To learn more, watch the replay of our webinar “Think big: Scale your business rules solutions up to the world of Big Data” webinar that explores how ODM business rules applied to big data can transform your decision automation strategy.

More Big Data stories

French insurer teams with IBM Services to develop fraud detection solution

Auto insurance fraud costs companies billions of dollars every year. Those losses trickle down to policyholders who absorb some of that risk in policy rate increases. Thélem assurances, a French property and casualty insurer whose motto is “Thélem innovates for you”, has launched an artificial intelligence program, prioritizing a fraud detection use case as its […]

Continue reading

Cloud innovation in real estate: Apleona and IBM rely on new technologies

Digitization does not stop at the proverbial concrete gold — real estate. In fact, the real estate industry is on the move. Companies are realizing the benefits of digital transformation and are capitalizing on the power of new technologies such as cloud, AI and blockchain. Take, for example, Apleona GmbH, one of Europe’s largest real […]

Continue reading

Innovate with Enterprise Design Thinking in the IBM Garage

We’ve all been there. You have an amazing idea that’s really exciting. Maybe it’s a home improvement project, or perhaps it’s a new business idea. You think about all the details required to make it real. But, once you get to the seventh action item, you’re not so excited anymore. Sometimes when we realize the […]

Continue reading