Managing storage

You manage the storage location in Cloud Object Storage for the PDF files for the data contracts. You can designate a target storage location for data extracts that are contained in a data product.

Required roles to complete this task

Collaborator role: Admin

IAM Service role for Cloud Object Storage: Manager

Storage for data contracts

Data Product Hub requires an instance of IBM Cloud Object Storage with a dedicated bucket for storing data contracts and for establishing a default project. The data contracts are stored as PDF files that describe the terms and conditions for data products. Either an uploaded file or a public URL for the data contract is required, but only the PDFs require storage space. The maximum file size that can be uploaded is 50 MB.

As the IBM Cloud account owner or Administrator, you provision an instance of Cloud Object Storage. As the Data Product Hub Administrator, you select a Cloud Object Storage instance and create a bucket to store the PDF files for the data contracts and other system files. A bucket is a logical abstraction that provides a container for data. When the bucket is created, the Default Data Product Delivery Project is automatically created to permit the delivery of data extracts. If your account already has an existing Cloud Object Storage instance, you can create the bucket in that instance. You need the IAM Service role of Manager for Cloud Object Storage to create a bucket.

Familiarity with IBM Cloud and Cloud Object Storage is required to configure IBM Cloud Object Storage for Data Product Hub.

New Cloud Object Storage instance

To provision an instance of IBM Cloud Object Storage:

  1. Log in to IBM Cloud.
  2. In the homepage, select Create resource.
  3. Search for the Object Storage tile and select it.
  4. Select a plan and give the service instance a name. The Standard plan includes a Free Tier with 5GB of free storage for 12 months.
  5. In Data Product Hub, from Administration > Configurations and settings > Storage, select the Cloud Object Storage instance you created.
  6. Click Create bucket to create the bucket for your PDFs.

For more information on the IBM Cloud Object Storage instance, see IBM Cloud docs: Getting started with Cloud Object Storage

Existing Cloud Object Storage instance

To select an existing Cloud Object Storage instance and create a bucket:

  1. From Administration > Configurations and settings > Storage, select a Cloud Object Storage instance for Data Product Hub.
  2. Click Create bucket to create the bucket for your PDFs.

Restoring a deleted instance of Cloud Object Storage

If the Cloud Object Storage instance where you are storing your data contracts is deleted, it is not deleted immediately. Instead, it is scheduled for reclamation in 7 days. You can restore the instance and the data before the 7 day reclamation period. After 7 days, the data is irreversibly destroyed.

Important: There is no reclamation period for Cloud Object Storage instances under the Lite plan. You cannot restore a deleted instance under the Lite plan. For Lite plan, the data is permanently deleted when the instance is deleted.

For information on how to restore a deleted Cloud Object Storage instance within the 7 day reclamation period, see Restoring a resource by using the CLI.

Storage for data extracts

For the Download data extract delivery method, you designate a connection as the target storage location for data extract files contained in data products. Typically, you use the same file storage location for all data extracts. Consumers can download the data extracts from this location.

The connection for the target storage location for data extracts requires read/write credentials.

To find connectors that support data extracts, both source and target, see Delivery methods for connectors.

Learn more

Parent topic: Setting up and administering Data Product Hub