January 11, 2018 By Paula Ta-Shma 3 min read

Introducing the Cloud Object Storage Bridge for Message Hub

IBM Message Hub (MH) now supports a bridge which continuously uploads a topic’s messages as objects in IBM Cloud Object Storage (COS).  IBM Cloud Object Storage is IBM’s latest generation, scalable cloud storage service, designed for high data durability, resiliency and security. The IBM Cloud Object Storage API is a REST-based API and supports a common set of S3 API functions for programmatic access. The storage service offers key features including server-side encryption for data at rest, flexible storage tiers, and resiliency options. IBM also continues to offer our first generation Open Stack Swift based API Object Storage service for customers with SWIFT-based applications and this service also supports a Message Hub Bridge.  NOTE:  IBM recommends customers use the latest generation IBM Cloud Object Storage strategicservice to take advantage of continued feature expansion and IBM Cloud service integration.

See this previously posted blog for a description of how an Object Storage bridge forms part of an end-to-end pipeline for ingesting and analyzing Message Hub data within IBM Cloud.

Bridges are a standard feature of MH which allow you to easily send your event streams from MH to other IBM Cloud services for consumption. You can set up a COS bridge with a few mouse clicks as shown below, and you don’t need any programming knowledge.

When you create a bridge in Message Hub (MH), you’ll now see a new Cloud Object Storage option:

In order to create a bridge, you need to specify the bridge name, the MH topic where the messages originate, and COS bucket where the messages will be stored. The upload thresholds determine how often objects are uploaded, and the partitioning type determines the object naming convention used.

For convenience, you can copy the JSON credentials from your COS account and paste them in the window below.

Alternatively, you can fill in the various fields as below

When you’ve completed these steps, the bridge is created. The COS bucket is also created if it didn’t already exist. At this point messages will be continuously uploaded from the chosen topic to the specified COS bucket.

The data can now be further transformed and analyzed using a variety of services including IBM Analytics for Apache Spark, the IBM Data RefineryIBM Watson Machine Learning, and the IBM Analytics Engine.

Get started with Message Hub and Cloud Object Storage today.

Full documentation for the COS bridge is available here.

More from Analytics

A new era in BI: Overcoming low adoption to make smart decisions accessible for all

5 min read - Organizations today are both empowered and overwhelmed by data. This paradox lies at the heart of modern business strategy: while there's an unprecedented amount of data available, unlocking actionable insights requires more than access to numbers. The push to enhance productivity, use resources wisely, and boost sustainability through data-driven decision-making is stronger than ever. Yet, the low adoption rates of business intelligence (BI) tools present a significant hurdle. According to Gartner, although the number of employees that use analytics and…

VeloxCon 2024: Innovation in data management

3 min read - VeloxCon 2024, the premier developer conference that is dedicated to the Velox open-source project, brought together industry leaders, engineers, and enthusiasts to explore the latest advancements and collaborative efforts shaping the future of data management. Hosted by IBM® in partnership with Meta, VeloxCon showcased the latest innovation in Velox including project roadmap, Prestissimo (Presto-on-Velox), Gluten (Spark-on-Velox), hardware acceleration, and much more. An overview of Velox Velox is a unified execution engine that is built and open-sourced by Meta, aimed at…

How the Recording Academy uses IBM watsonx to enhance the fan experience at the GRAMMYs®

3 min read - Through the GRAMMYs®, the Recording Academy® seeks to recognize excellence in the recording arts and sciences and ensure that music remains an indelible part of our culture. When the world’s top recording stars cross the red carpet at the 66th Annual GRAMMY Awards, IBM will be there once again. This year, the business challenge facing the GRAMMYs paralleled those of other iconic cultural sports and entertainment events: in today’s highly fragmented media landscape, creating cultural impact means driving captivating content…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters