Extending the System Data Engine data processing

This section provides instructions on advanced data processing using the System Data Engine.

Streaming CICS monitoring records by using a data stream definition
This section provides instructions on how to process and stream CICS® monitoring records.
Streaming CICS journal records by using a data stream definition
CICS applications can use the EXEC CICS WRITE JOURNALNAME command to write applications data to CICS user journals. CICS user journals can be defined to the System Management Facility (SMF) so that the journal records can be written in SMF type 110 subtype 0 records to the SMF log. By using the Z Common Data Provider, the SMF records that contain CICS user journal records can be processed and streamed to your analytics platform.
Streaming IMS user log records by using a data stream definition
When the IMS Log Write (LOGWRT) user exit is enabled, IMS log records, including IMS user log records, are written to System Management Facilities (SMF) for processing by the System Data Engine. However, to have the System Data Engine process the IMS user log records, you must also use System Data Engine language statements to define custom record and update definitions, and, optionally, to define template definitions for the advanced data filtering of IMS user log records.
Filtering a System Data Engine data stream by using a data stream definition
For a System Data Engine data stream, you can use the WHERE clause in the custom update definition to filter the records to be processed, and use the custom template definition that is associated with the update definition to filter the fields to be streamed by Z Common Data Provider.
Streaming structured data of your application by using a data stream definition
In addition to the SMF records that are produced by IBM® products and some third-party products, you can use Z Common Data Provider to stream your own SMF records and application data. By using this function, you can stream structured data of your application to analytics platforms.
Joining data streams for SMF record type 70 subtype 1
In SMF record type 70 subtype 1, some sections, like SMF70BCT (PR/SM partition data) and SMF70BPD (R/SM logical processor data), and SMF_070_LCD(Logical core data) and SMF_070_CPU(CPU data), are bound together. However, when these sections are respectively streamed through different data streams, such correlation is lost. You can join the data streams by using the key fields.

Parent topic: Configuration scenarios