Archiving S3 client data by using the AWS Command Line Interface

Edit online

Use the AWS Command Line Interface (AWS CLI) to archive Amazon S3 Glacier Flexible Retrieval objects to IBM Storage Protect and verify that the objects are automatically migrated to the configured tape storage pool.

Before you begin

Complete the configuration procedure described in Configuring operations for copying data from S3 client to tape.

Ensure that the AWS Command Line Interface (AWS CLI) is installed and that you have the access key and secret access key for the registered object client.

About this task

The AWS Command Line Interface (AWS CLI) provides an S3-compatible interface for interacting with the IBM Storage Protect Object Agent. You can use the AWS CLI to create buckets, upload objects, and verify archive operations. Objects that are uploaded by using the Glacier Flexible Retrieval storage class are automatically migrated from the cold-data-cache storage pool to the configured tape storage pool.

Procedure

Verify that the AWS CLI is installed.
```
aws --version
```
Configure the AWS CLI.
Configure the AWS CLI by specifying the access key and secret access key that were generated when the object client node was registered.
```
aws configure
```
Verify the existing buckets.

Use IBM Storage Protect administrative commands to verify the existing buckets that are associated with the registered object client.

In IBM Storage Protect, Amazon S3 buckets are represented as filespaces.
Create an S3 bucket.
For test environments that use self-signed certificates, specify the --no-verify-ssl option. In production environments, use trusted certificates and configure the appropriate certificate authority (CA) bundle.
```
aws s3 mb s3://<bucket_name>
--endpoint-url=https://<host_name>:9000
--no-verify-ssl
```
Verify that the bucket was created successfully.
Verify that the bucket is visible from both the AWS CLI and IBM Storage Protect.
```
aws s3 ls
--endpoint-url=https://<host_name>:9000
--no-verify-ssl
```
Upload an object by using the Glacier Flexible Retrieval storage class.
Objects that are uploaded by using the Glacier Flexible Retrieval storage class are written to the cold-data-cache storage pool and are then automatically migrated to the configured tape storage pool.
```
aws s3 cp <filename>
s3://<bucket_name>
--storage-class GLACIER
--endpoint-url=https://<host_name>:9000
--no-verify-ssl
```
Verify that the object was uploaded successfully.
```
aws s3 ls s3://<bucket_name>
--endpoint-url=https://<host_name>:9000
--no-verify-ssl
```
Confirm that the uploaded object is listed in the bucket.
Verify that the object is stored in the cold-data-cache storage pool.

Use IBM Storage Protect administrative commands to verify that the uploaded object is present in the configured cold-data-cache storage pool.
Verify the storage occupancy.

Issue the QUERY OCCUPANCY command to verify the storage occupancy for the registered object client.
Verify that the object is migrated to the tape storage pool.

IBM Storage Protect automatically migrates Glacier-class objects from the cold-data-cache storage pool to the configured tape storage pool.

Monitor migration activity to confirm that the archival process completed successfully.

Results

The object is archived successfully. IBM Storage Protect automatically migrates the object from the cold-data-cache storage pool to the configured tape storage pool for long-term retention.