IBM Support

S3_21 - Unable to write object to Amazon S3: The provided token has expired

Troubleshooting


Problem

This error means that the token provided for authentication has expired and you need to log in again.

Symptom

When running a pipeline in Data Collector your pipeline fails with the following error message:

ClosePipeline Status: RUNNING_ERROR: S3_21 - Unable to write object to Amazon S3, reason : com.amazonaws.services.s3.model.AmazonS3Exception: The provided token has expired. (Service: Amazon S3; Status Code: 400; Error Code: ExpiredToken; Request ID: RFWQNSK8C4WVRPAR; S3 Extended Request ID: u4IqJ8eh9avOrX0TRktCm4JSqgHw3qRjyyXrHvRqxmOsFndzuuNV8Z6VDALNtzkFF3Q=; Proxy: null), S3 Extended Request ID: u4IqJ8eh9avOrX0TRktCm4ZLwfNLT7JSqgHw3qRjyyXsFndzuuNV8Z6VDALNtzkFF3Q=

Resolving The Problem

Regenerate a valid token so you can authenticate against AWS servers. See the links to the documentation for more information about security and authentication in the Amazon stages.

Security in Amazon stages: https://docs.streamsets.com/portal/datacollector/5.9.x/help/datacollector/UserGuide/Pipeline_Configuration/AmazonSecurity.html#concept_ypw_hbj_3nb

Using instance profiles: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_switch-role-ec2_instance-profiles.html

Temporary security credentials in IAM: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp.html

Document Location

Worldwide

[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSM7CU","label":"IBM StreamSets Data Collector"},"ARM Category":[{"code":"","label":""}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]

Document Information

Modified date:
15 March 2025

UID

ibm17186094

Page Feedback