Summary report tab

The Summary tab is a constant tab that provides an aggregate overview of map coverage results. It outlines the total number of iterations and the number of non-executed maps in the Coverage view when you run a map in coverage mode. Any coverage IDs marked as Skip in the coverage settings are explicitly excluded from this report.

Coverage statuses

Throughout the summary report, three specific statuses are used to indicate the extent of map rule execution:

Covered
All of the map rules were executed.
Partially covered
Some of the map rules were executed, and some were not executed.
Not covered
None of the map rules were executed.

Summary report details

The Summary report tab displays the following information and metrics:

Aggregate summary
Provides a rolled-up, aggregate overview of the coverage status across all of the executed coverage runs combined. It evaluates the resulting coverage status across three specific map levels:
  • Top map: Displays the aggregated coverage status across all coverage runs for all map rules associated with the output cards of the top-level executable map.
  • Functional maps: Displays the aggregated coverage status across all coverage runs for all map rules within the functional maps.
  • Run maps: Displays the aggregated coverage status across all coverage runs for the run map rules within the executable and functional maps.
Coverage runs
Provides a detailed breakdown of every individual coverage run iteration. For each specific run, it tracks and displays:
  • Coverage ID: The unique identifier defined for the specific coverage run.
  • Execution status: The status of the map execution alongside the elapsed execution time for that specific run.
  • Map rule details: The specific coverage status for that unique test iteration reported across the map hierarchy levels (Top map, Functional maps, Run maps).
  • Final status: The overall final coverage status for that specific run ID (Covered, Partially Covered, or Not Covered).

Additional tab metrics

At the bottom of the Summary tab, you can view the following execution metrics:

Total elapsed time
Displays the total elapsed time combined across all of the coverage runs.
Report level
Shows the specific report level used to generate the coverage execution, which will be Outline, Details, or Verbose.

Error conditions and messages

If an error occurs during execution, the Summary tab reflects the failure. For example, if the main map fails to run because the source is unavailable, the status displays as Not Covered with a 0% coverage score, and the specific error code is provided.

Additionally, the Summary tab displays specific messages based on the map type, the availability of the source map, and the status of the coverage report:

  • If you click the map when the source map is open but the map coverage report is unavailable, only the Summary tab is displayed, showing the following message:
    Coverage report for <map> is unavailable.
  • If you attempt to view a report for a functional map (which does not generate its own map coverage report), the Summary tab displays the following message:
    Coverage report is not available for functional maps.
  • If the source map is not open and there is no active window, the Summary tab displays the following message:

    No active source map open to show coverage report.