Introducing the Cloud Object Storage Bridge for Message Hub

IBM Message Hub (MH) now supports a bridge which continuously uploads a topic’s messages as objects in IBM Cloud Object Storage (COS). IBM Cloud Object Storage is IBM’s latest generation, scalable cloud storage service, designed for high data durability, resiliency and security. The IBM Cloud Object Storage API is a REST-based API and supports a common set of S3 API functions for programmatic access. The storage service offers key features including server-side encryption for data at rest, flexible storage tiers, and resiliency options. IBM also continues to offer our first generation Open Stack Swift based API Object Storage service for customers with SWIFT-based applications and this service also supports a Message Hub Bridge. NOTE: IBM recommends customers use the latest generation IBM Cloud Object Storage strategicservice to take advantage of continued feature expansion and IBM Cloud service integration.

See this previously posted blog for a description of how an Object Storage bridge forms part of an end-to-end pipeline for ingesting and analyzing Message Hub data within IBM Cloud.

Bridges are a standard feature of MH which allow you to easily send your event streams from MH to other IBM Cloud services for consumption. You can set up a COS bridge with a few mouse clicks as shown below, and you don’t need any programming knowledge.

When you create a bridge in Message Hub (MH), you’ll now see a new Cloud Object Storage option:

In order to create a bridge, you need to specify the bridge name, the MH topic where the messages originate, and COS bucket where the messages will be stored. The upload thresholds determine how often objects are uploaded, and the partitioning type determines the object naming convention used.

For convenience, you can copy the JSON credentials from your COS account and paste them in the window below.

Alternatively, you can fill in the various fields as below

When you’ve completed these steps, the bridge is created. The COS bucket is also created if it didn’t already exist. At this point messages will be continuously uploaded from the chosen topic to the specified COS bucket.

The data can now be further transformed and analyzed using a variety of services including IBM Analytics for Apache Spark, the IBM Data Refinery, IBM Watson Machine Learning, and the IBM Analytics Engine.

Get started with Message Hub and Cloud Object Storage today.

Full documentation for the COS bridge is available here.

Paula Ta-Shma

IBM Research - Big Data Analytics

How Macmillan Publishers authored success using IBM Cognos Analytics

5 min read - Macmillan Publishers is a global publishing company and one of the “Big Five” English language publishers. If you're a reader, chances are good you've read a book from Macmillan. They published many perennial favorites including Kristin Hannah’s The Nightingale, Bill Martin’s Brown Bear, Brown Bear, what do you see? and some of the more recent bestsellers such as The Silent Patient by Alex Michaelides, Identity by Nora Roberts and Razorblade Tears by S. A. Cosby. It’s no wonder then that Macmillan…

Jabil is building reports with IBM Business Analytics Portfolio

3 min read - Jabil isn’t just a manufacturer, they are experts on global supply chain, logistics, automation, product design and engineering solutions. They are also interested and involved in the holistic application of emerging technologies like additive manufacturing, autonomous technologies, and artificial intelligence. They are a technologically motivated enterprise, so it’s no surprise that they would apply this forward-thinking view to their finance reporting as well. Jabil is a sizable operation with over 260,000 employees across 100 locations in 30 countries. The world's…

How a water technology company overcame massive data problems with ActionKPI and IBM

4 min read - Access to clean water is essential for the survival and growth of humans, animals and crops. Water technology companies worldwide provide innovative solutions to supply, conserve and protect water throughout the highly complex and technical water cycle of collection, treatment, distribution, reuse and disposal. After a series of international acquisitions, a leading water technology company formed an Assessment Services division to provide water infrastructure services to their customers. Through the formation of this group, the Assessment Services division discovered multiple…