Running a suite sequentially

Edit online

When you want tests to run one after the other, you can run a suite sequentially that maintains the correct order and accuracy of the test results.

Before you begin

You must have completed the following tasks:
  • Ensured that you are assigned a Team Space Owner, Project Owner, or Member with a Tester role to create or edit a test resource.
  • Ensured that a suite is available in your project.
  • Added tests or other suites to the suite.

About this task

During the playback, you can run all tests or only the failed tests. The Continue on Fail option ensures that the suite continues to run even if a test fails.

As the test runs, the three color-coded boxes display the counts of passed steps, failed steps, and errors. You can view the step details of the first failed step or error step by clicking the respective color-coded boxes. Also, you can view checkmarks for the steps that pass and crossmarks for the steps that fail.

Procedure

  1. Log in to Test Hub.
    The Projects page of the initial team space is displayed.
  2. Click My projects > project_name to open the project that contains the test assets.
    The Overview page of the project is displayed.
  3. Click Author > Test Editor.
    The Test Editor page and the test navigator panel are displayed.
  4. Click the .dts.yaml file in the list of Suites to open the suite.
    The tests or suites are displayed on the Suite Editor page.
  5. Click the Configure settings and data step.
    The Settings pane is displayed.
  6. Ensure that the Run in Parallel option is unchecked to run the test in sequence.
    Note: If Run in Parallel is selected, tests will execute simultaneously rather than sequentially.
  7. Verify that the Continue on Fail option is selected as the default setting, under the Options tab.
    Note: If you clear the Continue on Fail checkbox, the suite stops when the first test fails.
  8. Click the Run all icon icon, and then select the Run all > Run all on Default Cluster option.

    You can also select the Run all on Personal Agent option if the personal agent is in a ready state.

    You can view the following stages on the progress bar during the test run:
    • In transition: The test setup is in progress.
    • Running: The test is actively running.
    • Complete: The test run is completed. This section also displays the time taken for test run.
    • During the Running phase, you can view the following details:
      • A checkmark check mark icon after each test or suite that passes, and a crossmark cross mark icon for any failed test or suite.
      • The Results tab displays the test as In Progress during the test run.
    • After the test run is completed, you can view the following results:
      • The Results tab displays the test as Pass or Fail.
  9. Click image of an icon to open the Results page, where you can view the results, reports, and logs of the completed test run.

Results

You have run a suite sequentially.

What to do next

You can view the following information:

  • The details of the suites and individual test results from the Run Details tab.
  • The console output, which includes error messages and logs. See Accessing console output.
  • The test results, reports, and logs from the Results page after the test completes the run.
  • The summary of the test run, which includes passed or failed status, count of passed or failed tests or test steps, and the verification points in the functional report. See Viewing a Functional Report.