Uploading files from a cloud storage

Use the following links to learn how to upload files from a cloud storage:

Uploading a single file from a cloud storage

The Data source menu of the Manage tab and the Create process wizard allows you to upload only a single file from the cloud storage. To upload multiple files based on a pattern, see the Creating a new data connection and scheduling a pattern wise file upload from a cloud storage topic.

Creating a new data connection from the cloud storage

You can use the following steps to upload a single file from the cloud storage:

  1. In the left pane of the Manage tab, click Data source.

  2. In the Upload data source section, click the down arrow (down-arrow), and then click Upload file from a cloud storage.

New connection creation

  1. On the Connect page of the Upload data source from a cloud storage wizard, click Create a new connection to create a new connection. You can also create a connection using any one of the existing storage connections. For more information on creating such a connection, see Selecting a connection from the existing list.

  2. Click IBM Cloud® Object Storage or AWS S3 to choose the cloud storage from which you want to upload the files.

    • If you select IBM Cloud® Object Storage, then do the following steps:

    i. In the Name field, type a name for the connection.

    ii. Optional. In the Description field, type a description for the connection.

    iii. In the Bucket name, Location, Bucket instance CRN, Public endpoint, and Api key fields provide the values as indicated in the IBM Cloud® Object Storage instance. For more information on how to locate the values, see Example: Creating a new data connection to IBM Cloud® Object Storage.

    • If you select AWS S3, then do the following steps:

    i. In the Name field, type a name for the connection.

    ii. Optional. In the Description field, type a description for the connection.

    iii. In the Bucket name, Region, Access key, and Secret key fields provide the values as indicated in the AWS S3 instance.

  3. Click Verify connection to verify the accuracy of the values and if the connection is valid, click Next.

    Connect page

  4. On the Choose file page, select the file that you want to upload, and then click Upload.

    File selection


Note:

  • Current path: When you select Current path, all the files in the mentioned path are displayed.

  • Everywhere: When you select Everywhere, all the files in the cloud instance are displayed in the table.

    Both the Current path and Everywhere options applies not only to the files that is displayed in the table but also to the Search feature.


Creating a connection using an existing storage connection for single file upload

You can use the following steps to upload a single file from the cloud storage:

  1. In the left pane of the Manage tab, click Data source.

  2. In the Upload data source section, click the down arrow (down-arrow), and then click Upload file from a cloud storage.

  3. On the Connect page of the Upload data source from a cloud storage wizard, click Select from existing connection to create a data connection from the existing list of connections.

  4. On the Connect page, click the required connection, and then click Next.

    File selection from existing

  5. On the Choose file page, navigate through the required file path, and then select the required file, and then click Upload.

    File selection from existing2


Note:

  • Current path: When you select Current path, all the files in the mentioned path are displayed.

  • Everywhere: When you select Everywhere, all the files in the cloud instance are displayed in the table.

    Both the Current path and Everywhere options applies not only to the files that is displayed in the table but also to the Search feature.


Uploading multiple files from a cloud storage using patterns

Creating a new data connection and scheduling a pattern wise file upload from a cloud storage

You can schedule to upload multiple files to the application using the Schedule source menu on the Manage tab.

You can use the following steps to schedule file upload:

  1. In the left pane of the Manage tab, click Schedule source.

  2. On the Schedule source page, click Add schedule source.

  3. On the Connect page of the Create schedule source retrieval from cloud storage wizard, click Create a new connection to create a new connection.


    Note: You can also create a connection using any one of the existing storage connections. To do so, click Select from existing connection, and then click the connection using which you want to create the new connection, and then click Next.


  4. Click IBM Cloud® Object Storage or AWS S3 to choose the cloud storage from which you want to upload the files.

    • If you select IBM Cloud® Object Storage, then do the following steps:

    i. In the Name field, type a name for the connection.

    ii. Optional. In the Description field, type a description for the connection.

    iii. In the Bucket name, Location, Bucket instance CRN, Public endpoint, and Api key fields provide the values as indicated in the IBM Cloud® Object Storage instance. For more information on how to locate the values, see Example: Creating a new data connection to IBM Cloud® Object Storage.

    • If you select AWS S3, then do the following steps:

    i. In the Name field, type a name for the connection.

    ii. Optional. In the Description field, type a description for the connection.

    iii. In the Bucket name, Region, Access key, and Secret key fields provide the values as indicated in the AWS S3 instance.

  5. Click Verify connection to verify the accuracy of the values and if the connection is valid, click Next.

    Connect page

  6. On the Select files page, select the folder path from which you want to upload the files, and then click Next.


    Notes:

    • To select a file, you need to click the folder link and then use the glob patterns to select the required set of files or files.

    • In the following figure, note that the * pattern is used to select the set of files.


    Select files page

  7. On the Scheduling page, set the time interval at which the file must be uploaded, and then click Create. The created storage connection is displayed on the Schedule source page.