Troubleshooting
Problem
The issue is in the HTTP Client > OAuth 2 tab: Client ID and/or Client Secret are not correct. There might be a misspelling in Client ID and/or Client Secret or the wrong values are being used.
Symptom
Affected Stages: HTTP Client Origin, Processor, and Destination.
The pipeline fails on validation, preview, and start. The error is OAuth2.0 specific: Error HTTP_21 - OAuth2 authentication failed. Please make sure the credentials are valid. appears in the UI (screenshot) for the HTTP Client stage and the below stack trace appears in the logs:
UI reproduction:
Stack trace:
2024-03-28 19:17:40,876 ERROR An exception occurred while running the pipeline, com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Can't start pipeline due 1 validation error(s). First one: HTTP_21 - OAuth2 authentication failed. Please make sure the credentials are valid. ProductionPipelineRunnable *2fa45ede-bc11-11ec-97ea-8199f78480cf@37b4463f-bc11-11ec-97ea-bb8b6e2f67e3 ProductionPipelineRunnable-test__44106bbf-3445-4ca6-a405-79a1a0d413b4__37b4463f-bc11-11ec-97ea-bb8b6e2f67e3-test com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Can't start pipeline due 1 validation error(s). First one: HTTP_21 - OAuth2 authentication failed. Please make sure the credentials are valid. at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:134) ~[streamsets-datacollector-container-5.6.0.jar:?] at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:63) ~[streamsets-datacollector-container-5.6.0.jar:?] at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startInternal(StandaloneRunner.java:762) ~[streamsets-datacollector-container-5.6.0.jar:?] at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:755) ~[streamsets-datacollector-container-5.6.0.jar:?] at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:150) ~[streamsets-datacollector-container-5.6.0.jar:?] at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:214) ~[streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:44) ~[streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:25) ~[streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:210) ~[streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:214) ~[streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:44) [streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:25) [streamsets-datacollector-stagesupport-5.6.0.jar:?] at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:210) [streamsets-datacollector-stagesupport-5.6.0.jar:?] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_362] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_362] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_362] at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:88) [streamsets-datacollector-container-5.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_362] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_362] at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
Resolving The Problem
Use the correct Client ID and Client Secret for the request.
Document Location
Worldwide
[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSM7CU","label":"IBM StreamSets Data Collector"},"ARM Category":[{"code":"","label":""}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]
Was this topic helpful?
Document Information
Modified date:
15 March 2025
UID
ibm17186187