Configuring scalable data collection

Before you can use the scalable data collection architecture, you need to install and configure the components.

Before you complete the steps below, plan your deployment. For more information, see Planning your deployment.

To configure scalable data collection, complete the following steps:
  1. Install Logstash and create the required utility scripts.
  2. Install and configure Apache Kafka.
  3. Configure the instances of Logstash in the Sender cluster.
  4. Configure the instances of Logstash in the Receiver cluster.
  5. Install and configure HAProxy.
  6. Configure the Log File Agent.
  7. Create the logical data sources in Log Analysis.