Announcing the new IBM Cloud Activity Tracker and IBM Log Analysis streaming feature as a public beta.

The ability to share data and insights between services is a strength of cloud-architected applications. IBM Log Analysis and IBM Cloud Activity Tracker services on IBM Cloud are expanding their ability to share data with other cloud services and applications, and both services are introducing the ability to stream log and event data to IBM Cloud Event Streams. IBM Cloud Event Streams supports connectors to a wide range of systems, and the Kafka API allows you easily share data and insights within your broader application workspaces.

The new IBM Cloud Activity Tracker and IBM Log Analysis streaming feature is announced as a public beta today and initially available in the Dallas and Frankfurt regions.

This new feature enables and simplifies use cases for your IBM Cloud applications:

  • Forwarding cloud activity event data to a SIEM
  • Forwarding specific log and event data to other corporate tools while maintaining a more complete copy of data within IBM Cloud.
  • Aggregating then forwarding data to data lakes and other analysis tools.

The following diagram is an example of an end-to-end streaming use case:

This new Streaming feature is offered as an alternative to the existing Export API feature. The Streaming feature is an ideal alternative for scenarios where data forwarding needs are continuous, high volume and where the configuration should be managed at the service instance level. Data forwarded is a copy of the data which is processed within the service.

The Export feature continues to be an ideal solution when relying on the service’s template parsing tools defining custom fields. Export processes are activated by the user or programmatically and good for ad-hoc, reporting, and time-range specific use cases.  

Configure Streaming

The Streaming feature is currently accessible from IBM Log Analysis and IBM Cloud Activity Tracker instances hosted in the Dallas and Frankfurt regions. It is a feature offered as part of the 7-day, 14-day, 30-day and HIPAA premium search plans. To configure Streaming, you will first need to define an IBM Cloud Event Streams instance, then, configure your IBM Log Analysis or IBM Cloud Activity Tracker instance to stream the data. The same IBM Cloud Event Streams instance can be used to receive data from multiple IBM Log Analysis and IBM Cloud Activity Tracker instances.

Once a streaming connection has been established, it is next important to configure monitoring of the streaming connection and establish meaningful alerts. The service documentation describes a recommended Cloud Monitoring configuration helping you observe your streaming performance. Set up alerts tailored to your application’s performance to detect if data is streaming as expected.  

Optimize the scope of data to be streamed by setting up conditional streaming filters through streaming exclusion rules. Data streamed is a filtered subset of data retained within the IBM Log Analysis and IBM Cloud Activity Tracker instances.

Over the course of this beta, we will be preparing other regions to support the new streaming feature.

Learn more

If you are new to IBM Cloud Activity Tracker and IBM Log Analysis, we encourage you learn more about the services:

  • IBM Cloud Activity Tracker allows you to capture cloud activity events from your applications and users use of IBM Cloud and its Cloud Services.
  • IBM Log Analysis aggregates application log data from both agents and IBM Cloud services.
  • Both services offer the ability to alert, search and visualize log and event data for operational analysis and insight.
  • Both services offer the ability to archive and maintain compliance with SOC2, PCI and HIPAA.

Categories

More from Announcements

IBM TechXchange underscores the importance of AI skilling and partner innovation

3 min read - Generative AI and large language models are poised to impact how we all access and use information. But as organizations race to adopt these new technologies for business, it requires a global ecosystem of partners with industry expertise to identify the right enterprise use-cases for AI and the technical skills to implement the technology. During TechXchange, IBM's premier technical learning event in Las Vegas last week, IBM Partner Plus members including our Strategic Partners, resellers, software vendors, distributors and service…

Introducing Inspiring Voices, a podcast exploring the impactful journeys of great leaders

< 1 min read - Learning about other people's careers, life challenges, and successes is a true source of inspiration that can impact our own ambitions as well as life and business choices in great ways. Brought to you by the Executive Search and Integration team at IBM, the Inspiring Voices podcast will showcase great leaders, taking you inside their personal stories about life, career choices and how to make an impact. In this first episode, host David Jones, Executive Search Lead at IBM, brings…

IBM watsonx Assistant and NICE CXone combine capabilities for a new chapter in CCaaS

5 min read - In an age of instant everything, ensuring a positive customer experience has become a top priority for enterprises. When one third of customers (32%) say they will walk away from a brand they love after just one bad experience (source: PWC), organizations are now applying massive investments to this experience, particularly with their live agents and contact centers.  For many enterprises, that investment includes modernizing their call centers by moving to cloud-based Contact Center as a Service (CCaaS) platforms. CCaaS solutions…

See what’s new in SingleStoreDB with IBM 8.0

3 min read - Despite decades of progress in database systems, builders have compromised on at least one of the following: speed, reliability, or ease. They have two options: one, they could get a document database that is fast and easy, but can’t be relied on for mission-critical transactional applications. Or two, they could rely on a cloud data warehouse that is easy to set up, but only allows lagging analytics. Even then, each solution lacks something, forcing builders to deploy other databases for…