Running server test assets by using a cloud credential

Edit online

You can run tests that are listed as server test assets created in IBM® DevOps Test Hub (Test Hub) on a device cloud by using a cloud credential.

Before you begin

You must have completed the following tasks:

Read Test run considerations for using mobile device clouds, if you want to configure a run on a mobile device cloud.
Created a cloud credential in your team space that is configured to connect to the mobile device cloud. See Adding cloud credentials of mobile device clouds.
Ensured that you are a member of the cloud credential that is configured to connect to the mobile device cloud. See Viewing details of cloud credentials.
Ensured that you are assigned a role as a Member or Project Creator in the team space. See Managing members and their roles in a team space.
Ensured that you are assigned a role as a Project Owner or Tester in the project. See Managing access to the server projects.
Created a project in your team space in Test Hub. See Creating a project.
Added the remote Git repository that contains the test resources to the project. See Adding repositories to a server project.
Created a Web UI test in Test Hub. See Recording a Web UI test.
Completed the Xray integration, if you want to export the test results to a Jira issue in your Xray project in Jira. See Integration with Xray test management for Jira.

About this task

You can run tests on the supported device clouds such as BrowserStack Cloud, LambdaTest Cloud, and pCloudy Cloud.

Restriction: Tests that you record on a standard browser might fail when you play them back on a device cloud. To increase the probability of successful playback, record tests by using device emulation. See supported device profiles.

Procedure

Log in to Test Hub.
The Projects page of the initial team space is displayed.
Open the project that contains the test assets, and then click Execution.

Select the branch of the repository that contains the test assets.

The test assets that are contained in the selected branch of the repository are displayed in the following tabs on the Execution page:


Tab	Description
SUITES	Lists all suites, Compound Tests, JMeter tests, JUnit tests, Postman tests, Rate Schedules, Selenium tests, or VU Schedules that are in the selected branch of the repository.
TESTS	Lists all API tests, functional tests, performance tests, or server test assets that are in the selected branch of the repository.
ADVANCED	Lists all assets that are displayed when custom filters are applied for assets in the selected branch of the repository.

Select one of the following tabs based on the type of test assets that you want to run:
- TESTS
- ADVANCED
The test assets in the selected tab are displayed.
Identify the Server Test asset that you want to run by scrolling through the list, searching for the test, or applying a filter.
Clicking the test name displays the Details panel. You can view the details of the test such as the description, the branch in the repository that contains the asset, the Git details, and the details of the commits to the repository. You can also view the history of the test runs for the specific test under the History tab of the Details panel.
Click the Execute icon in the row of the identified test asset.
The Execute test asset dialog is displayed.
Select the version of the test resources that you want to run in the Version field.
Click Schedule and select the time if you want to schedule the test run. Else, skip the step.
Enter a label for the test run that helps you to identify the test on the Results page.
Follow the instructions to select a browser:
1. Click the ENVIRONMENT tab, if it is not already open.
2. Select an environment from the list that is available for the test run from the Environment drop-down list.
  The variables and profile overrides in the selected environment override the values defined in the test when you run a test or suite.
3. Select a device from the list of devices for the configured device cloud in the Browser drop-down list.
  The name of the browser is appended with the name of the device and name of the cloud credential set by the user in the Browser (Full device name : DeviceCloudName set by the user) format. For example, if the mobile device is Galaxy S10 and the cloud credential name is Lambda, then the name displayed in the list is Chrome(Galaxy S10 : Lambda).
Optional: Click the DATA SOURCES and select a dataset tab if you are running a test asset that contains datasets.
Optional: Click the VARIABLES tab, and then add or upload variables if the test requires a variable that must be passed to the test at the test run time.
Click the RESULTS tab and select an option if you want to export the test results to a Jira issue in your Xray project in Jira.
You must have set up Jira as a change management system and configured the Xray integration to export the results.
Click Advanced to enter any of the following values that must be passed to the test run if they are applicable for the test:
- JVM Arguments
- Program Arguments
- Environment Variables
Click Execute.
The test run is initiated.

Results

You have run a server test asset that is created in Test Hub on a device cloud.

What to do next

You can perform any of the following tasks:

Stop the test run at any point after the test run is initiated from the Execution page. See Stopping test runs.
Cancel a scheduled test run from the Execution page. See Canceling scheduled test runs.
View all the states of the test asset by clicking the Show in the Progress page icon for the test asset for which you started or scheduled the run. See Viewing the state of test assets.
View the progress of the test from the Progress page. See Viewing the progress of running test assets.
View the results, reports, and logs of the test from the Results page after the test completes the run. See Test results.