IBM Support

How to use an AWS profile on an engine which runs in a docker container?

Troubleshooting


Problem

  1. How can I use AWS Instance profile as the authentication method to connect securely to Amazon Web Services in my pipelines?

Symptom

  1. You want to use the AWS Instance profile as the authentication method to connect securely to Amazon Web Services in your pipelines.

Resolving The Problem

  1. To use an AWS Instance profile your engine will have to be deployed on an EC2 instance that has an associated instance profile. Go to the docker container and create an AWS profile. StreamSets supports role assumption based on AWS. (https://docs.streamsets.com/portal/datacollector/4.2.x/help/datacollector/UserGuide/Pipeline_Configuration/AmazonSecurity.html?hl=aws%2Cprofile )

    https://docs.aws.amazon.com/toolkit-for-visual-studio/latest/user-guide/keys-profiles-credentials.html

Document Location

Worldwide


[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSM21Y","label":"IBM StreamSets"},"ARM Category":[{"code":"","label":""}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]

Document Information

More support for:
IBM StreamSets

Software version:
All Version(s)

Document number:
7186078

Modified date:
15 March 2025

UID

ibm17186078

Manage My Notification Subscriptions