Monitoring job execution

By using the Apache Flink web interface, you can monitor how task managers execute jobs and verify that all the jobs are up and running.

Monitoring job throughput and back pressure
It is important to monitor the processing jobs throughput and back pressure to able to determine when the system needs to be scaled.
Retrieving job execution logs
Flink jobs ingest and process events before storing results in HDFS, Kafka, and Elasticsearch. If no results appear in one of those destinations, it is important to be able to investigate how the job were executed by looking at the logs.

Parent topic: Operating an Apache Flink cluster