YARN job fails with user not found error

A YARN job will fail if the user ID that is associated with the job does not exist on each YARN NodeManager node.

Symptoms

A YARN job fails after allocating and attempting to run the first container, as shown in the following example:
2021-01-13 01:39:41,127 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1610002694704_0015 failed 2 times due to AM Container for appattempt_1610002694704_0015_000002 exited with  exitCode: -1000
Failing this attempt.Diagnostics: [2021-01-13 01:39:41.094]Application application_1610002694704_0015 initialization failed (exitCode=255) with output: main : command provided 0
main : run as user is bigsql
main : requested yarn user is bigsql
User bigsql not found

Causes

This event can occur if the user ID that is associated with the job does not exist on each YARN NodeManager node. Load and ACID table compaction are examples of operations that run YARN jobs and could encounter this error.

Resolving the problem

Ensure that the missing user ID exists on each YARN NodeManager node.