IBM Support

Multiple VERTEX/ shuffle errors when running a query/process in secure environment

Troubleshooting


Problem

Multiple VERTEX/ shuffle errors when running a query/process in a secure environment. This article provides a workaround to solve this issue.

Symptom

Getting multiple VERTEX errors when running a query/process:

ERROR : Status: Failed
ERROR : Vertex re-running, vertexName=Map 1, vertexId=vertex_1654309827261_0063_1_00
ERROR : Vertex re-running, vertexName=Map 1, vertexId=vertex_1654309827261_0063_1_00
ERROR : Vertex re-running, vertexName=Map 1, vertexId=vertex_1654309827261_0063_1_00
ERROR : Vertex failed, vertexName=Reducer 2, vertexId=vertex_1654309827261_0063_1_01, 
diagnostics=[Task failed, taskId=task_1654309827261_0063_1_01_000000, diagnostics=[TaskAttempt 0 failed, 
info=[Error: Error while running task ( failure ) : org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle$ShuffleError: error in shuffle
WARN org.apache.hadoop.mapreduce.task.reduce.Fetcher: Invalid map id
java.lang.IllegalArgumentException: TaskAttemptId string : TTP/1.1 500 Internal Server Error
Content-Type: text/plain; charset=UTF is not properly formed
at org.apache.hadoop.mapreduce.TaskAttemptID.forName(TaskAttemptID.java:174)
at org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyMapOutput(Fetcher.java:284)
at org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:251)
at org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:149)

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SS4LSK","label":"Cloudera Data Platform Private Cloud Base with IBM"},"ARM Category":[{"code":"a8m3p0000006ws8AAA","label":"OpenSource DB-\u003ECloudera"}],"ARM Case Number":"TS014790140","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
21 November 2023

UID

ibm17080268

Page Feedback