Configuring the Data Collector

You can configure the Data Collector to collect z/OS® log data and System Management Facilities (SMF) data in either stream mode or batch mode and stream it to Apache Kafka.

About this task

• If you run the Data Collector in stream mode, you will need the following files:
  • <policy>.collection-config.json: Use this file to define the data sources to be collected by the Data Collector. You can generate this file through the intuitive Configuration Tool. For more detailed instructions, see Creating a policy for streaming data to Apache Kafka through Data Collector.
  • application.properties: This file is optional and can be used to define Kafka Transport Layer Security (TLS) or other parameters. You can make a copy of the sample file and update the copy.
  • Started task HBODCCOL: The sample procedure is located in the library hlq.SHBOSAMP. You can make a copy of the sample procedure and update the copy.
• If you run the Data Collector in batch mode, you will need the following files:
  • <policy>.collection-config.json: Use this file to define the Kafka server and topic name.
  • application.properties: This file is optional and can be used to define Kafka Transport Layer Security (TLS) or other parameters. You can make a copy of the sample file and update the copy.
  • Batch JCL HBODCBAT: The sample job is located in the library hlq.SHBOSAMP. You can make a copy of the sample job and update the copy.