Monitoring data ingestion health for performance data coverage
The Data collection overview report from data ingestion health section helps to analyze and monitor the summarized data availability. You can drill down from the summary-level data coverage to detailed level KPI group coverage and identifying the missing Resources in the KPI group. Currently, only daily summaries of performance data coverage are supported.
Sometimes, you might notice a delay in sending the network performance data from NiFi nodes
to Kafka. Incomplete data availability is seen in the following scenarios:
- Total data loss in some periods at source
- Late data at source
- Dropped data at source
- Data loss in transit to NiFi or File Collector Services
To help in these scenarios, data ingestion health reports are created in Telco Network Cloud Manager - Performance. You can monitor the following from these reports:
- Status of the data availability as daily summaries.
- KPI group coverage overview at a specific granularity period
- KPI group coverage details report displays the KPIs in the group and data coverage for the KPIs.
- Missing Resource types from the KPI group.
Data collection overview: Daily summary
Access and use the Data collection overview: Daily summary report.
- Click .You can see the following information on the report:
- Select Date is to select a specific date to view the data availability as daily summaries of one hour granularity. You can see 24 data points from 0 to 23.
- Data source is displayed from the installed Technology Pack. If you installed multiple packs, you can see multiple datasources.
- Resource count (max) that displays the total number of Resource instances for the day.
- Data availability percentage indicates color-coded representation of data
in hourly granularity.A legend that is displayed at the end of the report is represented in the following colors:
- Green indicates the High data availability=100%
- Yellow indicates the Intermediate data availability <100%
- Red indicates Low data availability=0%
KPI group overview
Click any specific granularity hour in the Data availability percentage
section to drill down to the KPI group overview report for that hour. You can
see the following information:
- Data source that is associated with the selected Technology Pack.
- Selected date is the date on which the data availability is monitored.
- Selected hour is the granularity period that is selected to drill down to the KPI group overview report.
- KPI group is the group that is associated with the data source.
- Resource count is the total number of Resource instances for the selected hour.
- Data availability percentage indicates color-coded representation of data
in 5 min granularity for the selected hour. Based on the granularity period, the number of data
points is determined. A legend that is displayed at the end of the report is represented in the following colors:
- Green indicates the High data availability=100%
- Yellow indicates the Intermediate data availability <100%
- Red indicates Low data availability=0%
- Gray indicates that no data is produced during that period.
KPI group detail chart
Click any specific granularity period in the Data availability percentage
section of the KPI group overview to drill down to the KPI group
detail chart for that period. You can see the following information:
- Data source that is associated with the selected granularity.
- KPI group that is associated with the data source.
- Selected date is the date on which the data availability is monitored.
- KPI column displays the KPI IDs that are associated with the KPI group.
- Resource type that is associated with each KPI in the group.
- Resource count is the total number of Resource instances for the selected time.
- Data availability percentage indicates color-coded representation of data
in hourly granularity.A legend that is displayed at the end of the report is represented in the following colors:
- Green indicates the High data availability=100%
- Yellow indicates the Intermediate data availability <100%
- Red indicates Low data availability=0%
KPI group detail chart: Missing resources
Click any specific granularity period in the Data availability percentage
section of the KPI group detail chart to drill down to the KPI group
detail chart: Missing resources for that period. You can see the following information:
- Data source that is associated with the selected granularity.
- KPI group that is associated with the data source.
- KPI
- Selected date is the date on which the data availability is monitored.
- Interval is the granularity period that is selected from the KPI group overview that can be seen in the Data availability percentage column in the KPI group detail chart.
- KPI column displays the KPI IDs that are associated with the KPI group.
- Resource id that is associated with each KPI in the group.
- Resource type that is associated with each KPI in the group.
- Click Export to export all the data
