Running a suite sequentially

When you want tests to run one after the other, you can run a suite sequentially that maintains the correct order and accuracy of the test results.

You must have completed the following tasks:
  • Ensured that you are assigned a Team Space Owner, Project Owner, or Member with a Tester role to create or edit a test resource.
  • Ensured that a suite is available in your project.
  • Added tests or other suites to the suite.

During the playback, you can run all tests or only the failed tests. The Continue on Fail option ensures that the suite continues to run even if a test fails.

  1. Log in to Test Hub.
    The Projects page of the initial team space is displayed.
  2. Click My projects > project_name to open the project that contains the test assets.
    The Overview page of the project is displayed.
  3. Click Author > Test Editor.
    The Test Editor page and the test navigator panel are displayed.
  4. Click the .dts.yaml file in the list of Suites to open the suite.
    The tests or suites are displayed on the Suite Editor page.
  5. Verify that the Continue on Fail option is selected as the default setting, under the Options tab.
    Note: If you clear the Continue on Fail checkbox, the suite stops when the first test fails.
  6. Click the Try Now icon try now icon, and then select the Run all option.
    You can view the following stages on the progress bar during the test run:
    • In transition: The test setup is in progress.
    • Running: The test is actively running.
    • Complete: The test run is completed.
    • During the Running phase, you can view the following details:
      • A checkmark check mark icon after each test or suite that passes, and a crossmark cross mark icon for any failed test or suite.
      • The Results tab displays the test as In Progress during the test run.
    • After the test run is completed, you can view the following results:
      • The Results tab displays the test as Pass or Fail.
  7. Click image of an icon to open the Results page, where you can view the results, reports, and logs of the completed test run.
You have run a suite sequentially.

You can view the following information:

  • The details of the suites and individual test results from the Run Details tab.
  • The console output, which includes error messages and logs. See Accessing console output.
  • The test results, reports, and logs from the Results page after the test completes the run.
  • The summary of the test run, which includes passed or failed status, count of passed or failed tests or test steps, and the verification points in the functional report. See Viewing a Functional Report.