Managing storage

You can designate a target storage location for data extracts that are contained in a data product.

Cloud platforms
Required roles to complete this task
Collaborator role: Admin

Storage for Data Contracts

Create storage buckets in IBM Cloud and in MCSP AWS Cloud environment to store data contracts for data products.

IBM Cloud

In IBM Cloud, you can create a bucket through the IBM Cloud Object Storage service:

  1. From the navigation menu, select Administration > Configuration and Settings > Storage.
  2. In the Storage for data contract section, click Create bucket to create the bucket for your data contracts.
  3. After the bucket is created, the bucket name will be displayed.

MCSP AWS Cloud

In MCSP AWS Cloud, you can create a bucket in Amazon S3:

  1. From the navigation menu, select Administration > Configuration and Settings > Storage.
  2. In the Storage for data contract section, you have two options to create a bucket:
    1. Dedicated bucket: The bucket is only used in Data Product Hub
    2. Shared bucket: The bucket is shared across the catalogs and only one bucket will be created for all of the catalogs in Data Intelligence. If no shared bucket is available, a new one will be created automatically.
  3. Click the Confirm button to create the bucket and the bucket name will be displayed.

Storage for data extracts

For the Download data extract delivery method, you designate a connection as the target storage location for data extract files contained in data products. Typically, you use the same file storage location for all data extracts. Consumers can download the data extracts from this location.

For the Deliver to watsonx.data and Access in watsonx.data delivery method, you must designate a connection as the target storage location for data extract files included in data products. Typically, the same storage location is used for all extracts, and consumers can download the files from this location.

To use the Deliver to watsonx.data delivery method:

  • Add the IBM Cloud Object Storage bucket as a component in watsonx.data.
  • Configure the same bucket as a connection in Data Product Hub.

The connection for the target storage location for data extracts requires the following:

  • Read-write credentials
  • Supported by the Data Extract delivery method
  • A bucket with public URL, otherwise the download link will not work
  • If it is a Cloud Object Storage connection, HMAC should be enabled

To find connectors that support data extracts, both source and target, see Delivery methods for connectors.