Summary report tab
The Summary tab is a constant tab that provides an aggregate overview of map coverage results. It outlines the total number of iterations and the number of non-executed maps in the Coverage view when you run a map in coverage mode. Any coverage IDs marked as Skip in the coverage settings are explicitly excluded from this report.
Coverage statuses
Throughout the summary report, three specific statuses are used to indicate the extent of map rule execution:
- Covered
- All of the map rules were executed.
- Partially covered
- Some of the map rules were executed, and some were not executed.
- Not covered
- None of the map rules were executed.
Summary report details
The Summary report tab displays the following information and metrics:
- Aggregate summary
- Provides a rolled-up, aggregate overview of the coverage status across
all of the executed coverage runs combined. It evaluates the resulting
coverage status across three specific map levels:
- Top map: Displays the aggregated coverage status across all coverage runs for all map rules associated with the output cards of the top-level executable map.
- Functional maps: Displays the aggregated coverage status across all coverage runs for all map rules within the functional maps.
- Run maps: Displays the aggregated coverage status across all coverage runs for the run map rules within the executable and functional maps.
- Coverage runs
- Provides a detailed breakdown of every individual coverage run
iteration. For each specific run, it tracks and displays:
- Coverage ID: The unique identifier defined for the specific coverage run.
- Execution status: The status of the map execution alongside the elapsed execution time for that specific run.
- Map rule details: The specific coverage status for that unique test iteration reported across the map hierarchy levels (Top map, Functional maps, Run maps).
- Final status: The overall final coverage status for that specific run ID (Covered, Partially Covered, or Not Covered).
Additional tab metrics
At the bottom of the Summary tab, you can view the following execution metrics:
- Total elapsed time
- Displays the total elapsed time combined across all of the coverage runs.
- Report level
- Shows the specific report level used to generate the coverage execution, which will be Outline, Details, or Verbose.
Error conditions and messages
If an error occurs during execution, the Summary tab reflects the failure. For example, if the main map fails to run because the source is unavailable, the status displays as Not Covered with a 0% coverage score, and the specific error code is provided.
Additionally, the Summary tab displays specific messages based on the map type, the availability of the source map, and the status of the coverage report:
- If you click the map when the source map is open but the map
coverage report is unavailable, only the Summary tab is
displayed, showing the following message:
Coverage report for <map> is unavailable. - If you attempt to view a report for a functional map (which does not generate
its own map coverage report), the Summary tab displays
the following message:
Coverage report is not available for functional maps. -
If the source map is not open and there is no active window, the Summary tab displays the following message:
No active source map open to show coverage report.