Ingesting metadata from IBM Storage Scale file system scan in IBM Spectrum Discover

Records are inserted into IBM Spectrum® Discover for indexing when they are pushed to a Kafka connector topic corresponding to the type of data being ingested. In the case of IBM Storage Scale, the Kafka connector topic type is scale-scan-connector-topic.

About this task

A Kafka client producer is required to put the IBM Storage Scale file system scan file records onto the Kafka connector topic. The following steps show how to use the ingest alias command to push the records in the list.metaOcean file (or another named file) onto the Kafka connector topic.

Procedure

  1. Run the following command to ingest the data:
    $ ingest /opt/ibm/metaocean/data/producer/list.metaOcean
  2. Replace the list.metaOcean path with the path of the file that you want to ingest.