Monitoring Hadoop YARN

After you install the Instana host agent, the Hadoop YARN sensor is automatically installed and enabled. You can view metrics that are related to Hadoop YARN in the Instana UI.

Supported versions

Currently, supported versions are from 2.3.x to 3.3.x.

Viewing metrics

To view the metrics, complete the following steps:

  1. In the sidebar of the Instana UI, select Infrastructure.
  2. Click the specific monitored host.

Then, you can see a host dashboard with all the collected metrics and monitored processes.

Instana supports automatic discovery and monitoring of Hadoop YARN ResourceManager and NodeManager.

Configuration data

  • Cluster ID
  • Version
  • State
  • Start time
  • Nodes
    • Labels
    • State
    • Rack
    • HTTP address
    • Last health update
    • Health report
  • Most Recent Apps
    • Application ID
    • State
    • Name
    • Final status
    • User
    • Type
    • Start time
    • Finish time
    • Tracking URL

Performance metrics

Metric Description Granularity
Active nodes The number of active cluster nodes 1 second
Lost nodes The number of lost cluster nodes 1 second
Unhealthy nodes The number of unhealthy cluster nodes 1 second
Decommissioned nodes The number of decommissioned cluster nodes 1 second
Running apps The number of apps that are running 1 second
Pending apps The number of apps that are pending 1 second
Failed apps The number of failed pending 1 second
Containers running The number of running cluster containers 1 second
Available memory Available cluster memory 1 second
Used memory Used cluster memory 1 second
Reserved memory Reserved cluster memory 1 second
Available virtual cores Available cluster virtual cores 1 second
Used virtual cores Used cluster virtual cores 1 second
Reserved virtual cores Reserved cluster virtual cores 1 second

Nodes

Metric Description Granularity
Containers running The number of running containers 1 second
Available memory Available node memory 1 second
Used memory Used node memory 1 second
Available virtual cores Available node virtual cores 1 second
Used virtual cores Used node virtual cores 1 second

Health Signatures

Each sensor has a curated knowledge base of health signatures that are evaluated continuously against the incoming metrics and are used to raise issues or incidents depending on user impact.

Built-in events trigger issues or incidents based on failing health signatures on entities, and custom events trigger issues or incidents based on the thresholds of an individual metric of any entity.

For more information about built-events for the Hadoop YARN sensor, see the Built-in events reference.