Running manual tests in off-line mode

In certain situations, you might need to run manual tests off-line. The Microsoft Excel Importer Utility includes everything that you need to export manual test scripts from the repository, run them off-line, and then import the test results back into the repository.

Before you begin

Install the Microsoft Excel Importer from the Jazz® Team Wiki.

About this task

Here are some scenarios that might require off-line testing:
  • You are in an isolated location, where you do not have access to the internet.
  • You run tests on a server that is not connected to the Engineering Test Management server.
  • You perform testing in the field by using a hand-held device.

Procedure

To run a manual test off-line:

  1. Export the file from the Engineering Test Management repository:
    1. Locate the test case execution record or test case from one of the following locations:
      • In the main menu, click Execution > Browse > Test Case Execution Records.
      • In the main menu, click Construction > Browse > Test Cases.
      • Open the Test Case Execution Records section of a test case.
    2. Select the test case execution record or test case.
      Note: To run multiple manual test scripts off-line, select up to 50 test case execution records at a time and then click Run Offline. This creates a compressed file that you can import with the Excel Importer utility. The limit of 50 test case execution records exists to control the size of the exported data. (This feature is only supported for multiple test case execution records, not multiple test cases.)
      Tip: You can use the advanced server property to specify the maximum number of offline executions that can be run at a time. In 6.0.5 release, you can edit the value of maximum number of offline executions.

      During offline execution, if a valid test script is not associated with a test case execution record, you can skip the invalid items and still continue the execution.

    3. Click the arrow next to the Run icon (Run), and then click Run Offline:
      Run Offline
    4. Save the RQMS file to a directory.
      Note: The RQMS file includes everything that you need to create a test result, such as the XML, images, and links. Links to associated test artifacts are maintained. Also, a CFG file, which is used later in this procedure for mapping fields, is created and put into the same folder where the RQMS file resides.
      CAUTION:
      Do not modify the RQMS file manually. If the file is changed, it will not work.
    5. Optional: If the manual test script that you are executing has file attachments that are needed while running the script off-line, you must save them separately from the RQMS file. To save the attachments, click Construction > View Test Scripts to view all test scripts, then click on the attached files and save them locally.
  2. Import the RQMS file into Microsoft Excel:
    1. Open Microsoft Excel.
    2. From the menu, click RQM > Import for Offline.
    3. Browse to the file location, and select the RQMS file.
    4. Click Open, and then click Import. The RQMS file is converted to a Microsoft Excel (XLS) file after being imported into Microsoft Excel.
      Note: The Quality Management rich text editor allows the creation of tables. However, Microsoft Excel does not support in-line tables. As a result of this limitation, tables in test script steps are not formatted properly in Microsoft Excel.
    5. Save the file.
    The Microsoft Excel (XLS) file is saved in Protected View. To enable editing, click Review and select Unprotect sheet.
    Note: Any custom attributes associated with manual test script steps are shown in read-only mode.
  3. Run the test and edit the XLS file in Microsoft Excel:
    1. As you perform each step in the application under test, assign it a verdict in the Step Result column by clicking the arrow to the right of the cell. You can choose from a set of allowed values:
      • Pass
      • Fail
      • Blocked
      • Error
      • Inconclusive
    2. Optional: Enter text in the Actual Result and Comments cells.
    3. You can also add images by clicking a cell in the Actual Result column, and then clicking Insert > Picture > From File from the menu.
      Tip: Large images that are exported from the repository to Microsoft Excel display as thumbnails. Click the image to toggle between the thumbnail and the full size.
    4. Select the picture, and click Insert.
      Important: When inserting images into a cell, you must ensure that the upper-right corner of the image is within the cell. For multiple images in a single cell, stack the images, ensuring that the upper-right corner of each image is within the cell. The images display in a single, vertical line in the test result after being imported into the repository. The order of appearance is based on the order in which you add the images to the cell.
      Insert image
    5. For the Overall Result, click the arrow to the right of the cell, and select a verdict:
      • Pass
      • Incomplete
      • Partially Blocked
      • Fail
      • Error
      • Blocked
      • Permanently Failed
      • Deferred
    6. Optional: If you are not completing the whole process at one time, save the file.
  4. Export the file back into same repository from where you downloaded the RQMS file:
    1. From the Microsoft Excel menu, click RQM > Export to Repository.
    2. Complete the repository information:
      • RQM server: Type the server name, such as https://localhost:9443/qm, where localhost is the host name of your server, and 9443 is the port number.
      • User Name: Type a valid user ID.
      • Password: Type a valid the password, and then click Validate to verify the repository information.
      • Project: Click the arrow to the right of the field, and select the project. A dialog box displays the message, Credentials Valid, after you enter valid information for the server.
    3. Select the appropriate mapping file.
      The mapping CFG file is located in the same directory as the RQMS file that was generated earlier.
    4. Click Export.
      Note: You must export the execution results back to the same repository.
    5. After you receive the message Exporting completed successfully, click Done.

Results

To see the test results in the repository, go to the main menu and click Execution > Browse > Test Case Results. Click the link under the State column.