Importing S3 data by using cron tasks

To import data from Simple Storage Service (S3), you can use a cron task to import data that is read by the S3 handler.

About this task

To import data, configure an endpoint that uses the S3 handler to read the data. Then, import the data by using one of the following cron tasks:
LOADXMLJSONOBJECT
Loads XML and JSON files from cloud storage.
LOADFLATOBJECT
Loads flat files, such as CSV files, from cloud storage.

Procedure

  1. Create three buckets in any S3 volume for the data that you want to load, one to store the files that you import, one to recover the files, and a third bucket to store backups of the files that you want to import.
    Attention: In S3-based loading, Maximo® Manage supports two ways to setup S3 buckets:
    • You can setup three sibling bucket folders at the same level naming them as follows:
      <S3bucketname>
      <S3bucketname>recovery
      <S3bucketname>backup
    • Or, the recommended way is to setup one root bucket folder, and two child bucket folders under the root bucket.
      <S3bucketname>
                            recovery
                            backup
  2. In the End Points application, create an endpoint that specifies the S3 handler.
    For more information, see Configuring an endpoint.
  3. In the Cron Task Setup application, create and activate the cron task instance to import the files:
    1. Create a cron task instance for the cron task that you want to use to import files. You can select one of the following cron tasks:
      Table 1. Cron tasks for loading S3 files
      Cron task Description
      LOADXMLJSONOBJECT Loads XML and JSON files from cloud storage.
      LOADFLATOBJECT Loads flat files, such as CSV files, from cloud storage.
      When you configure the ENDPOINTNAME parameter for the cron task instance, ensure that you specify the end point that you created in step 2. The endpoint name must be in uppercase.
    2. Provide any other instance details and enter a schedule for running the cron task instance.
    3. Activate the cron task.
    For more information about creating cron task instances, see Working with instances of cron tasks.