Monitoring Hadoop YARN
The Hadoop YARN sensor is automatically deployed and installed after you install the Instana agent.
Supported versions
Currently supported versions are from 2.3.x to 3.3.x.
Metrics collection
To view the metrics, select Infrastructure in the sidebar of the Instana User interface, click a specific monitored host, and then you can see a host dashboard with all the collected metrics and monitored processes.
Instana supports automatic discovery and monitoring of Hadoop YARN ResourceManager and NodeManager.
Configuration data
- Cluster ID
- Version
- State
- Start time
- Nodes
- Labels
- State
- Rack
- HTTP address
- Last health update
- Health report
- Most Recent Apps
- Application ID
- State
- Name
- Final status
- User
- Type
- Start time
- Finish time
- Tracking URL
Performance metrics
| Metric | Description | Granularity |
|---|---|---|
| Active nodes | The number of active cluster nodes | 1 second |
| Lost nodes | The number of lost cluster nodes | 1 second |
| Unhealthy nodes | The number of unhealthy cluster nodes | 1 second |
| Decommissioned nodes | The number of decommissioned cluster nodes | 1 second |
| Running apps | The number of apps running | 1 second |
| Pending apps | The number of apps pending | 1 second |
| Failed apps | The number of failed pending | 1 second |
| Containers running | The number of running cluster containers | 1 second |
| Available memory | Available cluster memory | 1 second |
| Used memory | Used cluster memory | 1 second |
| Reserved memory | Reserved cluster memory | 1 second |
| Available virtual cores | Available cluster virtual cores | 1 second |
| Used virtual cores | Used cluster virtual cores | 1 second |
| Reserved virtual cores | Reserved cluster virtual cores | 1 second |
Nodes
| Metric | Description | Granularity |
|---|---|---|
| Containers running | The number of running containers | 1 second |
| Available memory | Available node memory | 1 second |
| Used memory | Used node memory | 1 second |
| Available virtual cores | Available node virtual cores | 1 second |
| Used virtual cores | Used node virtual cores | 1 second |
Health Signatures
For each sensor, there is a curated knowledgebase of health signatures that are evaluated continuously against the incoming metrics and are used to raise issues or incidents depending on user impact.
Built-in events trigger issues or incidents based on failing health signatures on entities, and custom events trigger issues or incidents based on the thresholds of an individual metric of any given entity.
For information about built-events for the Hadoop YARN sensor, see the Built-in events reference.