Understanding the reports
When you run a test suite, it produces a large amount of
information and places the relevant information in a report.
All test reports contain the following information:
- Summary: Shows the scenario success rate as a percentage of scenarios that ran successfully. It also shows information about the test, including the scenario file, decision operation, and rule source. Links are provided to rule and data sources.
- Results: Shows the results from running the test. It lists the scenarios in the scenario file, and the status and result of each scenario. If you ran your test on collections, you can click Details to obtain more information on the observed and expected results. Collections are presented with types and attributes that are verbalized according to the available vocabulary at test runtime. By default, the vocabulary used corresponds to the user locale vocabulary if there is one.
The results for the scenarios use the following statuses:
- Successful: A test is successful when the expected results match the actual results.
- Unsuccessful: A test is unsuccessful when the expected results are different from the actual results.
- Error: An error is reported when the test cannot run the scenarios, for example, when an entry in the scenario file is not correctly formatted.
You can filter the results in the window for displaying the test reports. You can show only the unsuccessful tests to reduce the amount of information in the report and to focus your attention on the failed cases.