Monitoring Hadoop YARN
After you install the Instana host agent, the Hadoop YARN sensor is automatically installed and enabled. You can view metrics that are related to Hadoop YARN in the Instana UI.
Currently, supported versions are from 2.3.x to 3.3.x.
To view the metrics, complete the following steps:
- In the sidebar of the Instana UI, select Infrastructure.
- Click the specific monitored host.
Then, you can see a host dashboard with all the collected metrics and monitored processes.
Instana supports automatic discovery and monitoring of Hadoop YARN ResourceManager and NodeManager.
- Cluster ID
- Start time
- HTTP address
- Last health update
- Health report
- Most Recent Apps
- Application ID
- Final status
- Start time
- Finish time
- Tracking URL
|Active nodes||The number of active cluster nodes||1 second|
|Lost nodes||The number of lost cluster nodes||1 second|
|Unhealthy nodes||The number of unhealthy cluster nodes||1 second|
|Decommissioned nodes||The number of decommissioned cluster nodes||1 second|
|Running apps||The number of apps that are running||1 second|
|Pending apps||The number of apps that are pending||1 second|
|Failed apps||The number of failed pending||1 second|
|Containers running||The number of running cluster containers||1 second|
|Available memory||Available cluster memory||1 second|
|Used memory||Used cluster memory||1 second|
|Reserved memory||Reserved cluster memory||1 second|
|Available virtual cores||Available cluster virtual cores||1 second|
|Used virtual cores||Used cluster virtual cores||1 second|
|Reserved virtual cores||Reserved cluster virtual cores||1 second|
|Containers running||The number of running containers||1 second|
|Available memory||Available node memory||1 second|
|Used memory||Used node memory||1 second|
|Available virtual cores||Available node virtual cores||1 second|
|Used virtual cores||Used node virtual cores||1 second|
Each sensor has a curated knowledge base of health signatures that are evaluated continuously against the incoming metrics and are used to raise issues or incidents depending on user impact.
Built-in events trigger issues or incidents based on failing health signatures on entities, and custom events trigger issues or incidents based on the thresholds of an individual metric of any entity.
For more information about built-events for the Hadoop YARN sensor, see the Built-in events reference.