Setting up Apache NiFi
Set up and start Apache NiFi to convert the data files that are collected from external Kafka. Convert the data to Avro format records and write them to Kafka. These records are then picked up by File Collector for processing the metrics and device inventory data.
Access the NiFi UI
Follow these steps to access the NiFi web interface on OpenShift® Container Platform:
- Log in to your cloud platform web console of your cluster.
- Make sure you are in
tncpproject or namespace. - Navigate to .
- Click the NiFi route link.
You can see the UI that has a canvas to orchestrate a data flow for the installed File-based Technology Packs:
- Open a web browser and type the following URL on Kubernetes cloud
platform:
http://<node_hostname>:30026/nifi
Where, <node_hostname> is the hostname of any node in your cluster.
30026 is the port number of the NiFi Service on the node where it is installed.
You can see the UI that has a canvas to orchestrate a data flow for the installed File-based Technology Packs:
Configuring the NiFi flow for Kubernetes Technology Pack
| Processor | Property | Default value |
|---|---|---|
| ConsumeKafka | Kafka brokers | <external_kafka_host_IP>:9092 |
| Topic Name(s) | <kafka_topic_name> | |
| Group ID | <kafka_topic_name> | |
| PublishKafka | Kafka brokers | kafka:9092 |
| QueryRecord | Cache Schema | Update the interval value to 300 in the select statement. |
Configuring the NiFi flow for VMware Technology Pack
| Processor | Property | Default value |
|---|---|---|
| ConsumeKafka | Kafka brokers | <external_kafka_host_IP>:9092 |
| Topic Name(s) | <kafka_topic_name> | |
| Group ID | <kafka_topic_name> | |
| PublishKafka | Kafka brokers | kafka:9092 |
| QueryRecord | Cache Schema | Update the interval value to 300 in the select statement. |