Setting up Data Collector
One method to ingest data sources is to install IBM® Data Collector on a VM and register it with the platform. You can use as many Data Collector instances as you need in your deployment.
How the Data Collector works
Data Collector sends events to the platform by using a Transport Layer Security over the Transmission Control Protocol (TLS over TCP) connection to Kafka. When Data Collector uses TLS over TCP, it buffers incoming events during times when it is disconnected from the platform and sends them when the connection is restored. Buffer capacity can be configured, and is limited by the available memory and disk space.
You can use as many Data Collector instances as you need in your environment. The number of instances that you need depends on the number of events per second (EPS) that you need to send and receive. Review the system requirements to ensure that your environment is prepared for Data Collector. For more information, see System requirements for Data Collector.