Data ingestion

Data ingestion is a mandatory process to import live data from external systems to Sterling Intelligent Promising for data modeling purposes. As part of this process, you must provision IBM Cloud® Object Storage. Then, you configure the logical storage buckets for the data feed types in Sterling Intelligent Promising. You can use the file transfer adapter that is provided or an existing IBM Cloud Object Storage integration to transfer the data.

  1. Obtain a subscription to IBM Cloud Object Storage. For more information, see Getting started with IBM Cloud Object Storage. Then, create separate storage buckets for each data type.
  2. Use the file transfer adapter to upload the CSV files for the various data feed types. To start this process, download the file transfer adapter. For more information, see Downloading, installing, and configuring the Sterling Intelligent Promising file transfer adapter.
  3. Familiarize yourself with exceptions to the requirements for data ingestion.
    • If you are using the inventory service as your inventory master, you don't need to upload Supply or Availability data.
    • However, if you manage your data by using an external system, you must configure all the data feed types. For more information, see Data feed types overview.
    • If you are using the catalog service API to maintain your catalog data, the catalog item data feed is not required. For more information, see Transferring catalog item data.
  4. Configure the IBM Cloud Object Storage endpoints for each data feeds type. For more information see, Configuring endpoints for file ingestion rules. For more information about file ingestion, see Starting the file ingestion process.
  5. Use the file transfer adapter or custom upload utilities to upload the .csv files to the IBM Cloud Object Storage buckets that you configured.
  6. Monitor the status of the data ingest process and resolve any errors. For more information, see Monitoring data for file ingestion.