Viewing the execution results of a test suite

Summary and detailed reports can be displayed for one test suite instance at a time. An execution summary for the selected test suite instance is displayed at the top of the Results Gallery perspective. Results that are specific to a test suite instance can be listed in the Results Gallery. The results of one or more test suite instances can be deleted from the results database directly within the Results Gallery or from the command line.
Summary report of test suite run

The summary report contains the following information:

Column Description
Resource Displays the contents of the selected test suite, with details for each suite resource that is provided in the remaining columns.
Notes Indicates whether a note is saved for the selected scenario or suite resource.
Status The overall status of the selected resource, either Passed or Failed.
Total Iterations The total number of iterations of the selected resource that were run in the test suite. For a scenario, the total of all iterations for child tests is displayed. If a scenario contains child scenarios, the total of all child resources is displayed.
Passed The number of iterations of the selected resource that passed. For a scenario, the total number of passed child tests is displayed.
Failed The number of iterations of the selected resource that failed. For a scenario, the total number of failed child tests is displayed.
Start Time The time when the selected resource’s execution began.
End Time The time when the selected resource’s execution ended.
Exec Time (ms) The overall time (in milliseconds) that the selected resource took to complete its execution. For the overall scenario, this time includes set up and tear down phases.
  • To reload the summary, click the Reload icon Reload in the toolbar.
  • To view Probe results for the selected resource, click the Probe Results icon Probe Results.
  • To expand the selected node, click the Expand Selection icon Expand Selection. To collapse the selected node, click the Collapse Selection icon Collapse Section.
  • Use the Iteration Filter option to filter the report to view only the iterations that have either passed or failed. The Iteration Filter option works only if the test contains at least one of the iterate actions.
.

Deleting the results of a test suite

If a suite was run in a test cycle, the suite’s past results cannot be deleted as described here. Current results can be deleted, and deleting the test cycle itself deletes the test suite results.

To delete test suite results from the Results Gallery, click the Delete icon Delete on the main toolbar. After you click the icon, the Delete Results dialog is displayed, providing you several options for how to delete result data.

Delete results

  • To delete only the displayed results (that is, the results of the currently selected test suite instance), enable the Delete currently shown results option.
  • To delete multiple result sets for the selected suite, enable the Delete results up to and including option and enter the date for which all results and all earlier results are to be deleted. When you are deleting multiple results, wildcard options can delete a broader range of data:
    • For ALL suites, you can delete results for all test suites before and including the selected date.
    • For ALL projects, you can delete all test suite results in all projects within the database before and including the selected date.

If any test suites are designated to be kept (see Notes), they are not removed by the delete action. For more information about commands that delete test results, see Managing test results.

Selecting a test suite instance

Follow the steps to select a test suite instance in the Results Gallery. A list of results that are related to this test suite instance can then be viewed or deleted.

  1. Select Suite as the resource type, click Browse next to the Resource field, locate, and select the wanted test suite in the project resource dialog, then click OK.
  2. For the specified suite, select the execution instance from the Instance list. The date, time, and environment of each instance is displayed, and the status (passed or failed) of the instance is indicated by the color (green or red) of its entry.
    Test instance selection list
    If you do not see an expected instance, click the Reload icon Reload icon to refresh the contents of the list

The execution summary of the selected instance is displayed (top), and detailed reports for the instance can be selected in the report viewer area.

Managing suite results and suite run archive policies

Follow the steps to view the suite run history and to see the actions you can do against the suite run archive policies.

  1. Select Suite as the resource type, click Browse next to the Resource field, locate, and select the wanted test suite in the project resource dialog, then click OK.
  2. For the specified suite, select the Modify Suite Run Archive Policies icon.
    View suite run history and change suite run archive policies
Tip: You can change suite archive policies only if you set the application preference (Prompt for Suite Run Archive Policy) to run a suite with a policy.

The Suite Run History dialog opens. You can select, display, or delete one or more items in the suite run history. You can also change the suite archive policies to remove suite run history from the results database or change the time period to keep suite run history in the results database.

Important: Suite archive policies do not apply to test suites that are run in a test cycle. The Suite Run History Items might not show any entries if all the test suites are run in a test cycle.

An empty suite run history


Feedback