qTest App Quick Start Guide

The qTest App is an application that allows testers to execute tests outside of the full browser-based experience of qTest Manager. qTest App application utilizes browser-based qTest Manager's APIs to download tests to user's devices. Then, user can execute their tests even their device does not have internet connection, we call this Offline Mode. When switched back to Online Mode with internet connection, user can upload all their executed tests back to qTest Manager.

Application Main Flow

  1. Login Step 1 - Provide qTest URL

  2. Login Step 2 - Provide User Email and User Password

  3. Navigation - Select your Project

  4. View Test Information - View information of your tests

  5. Download Tests - Download Test Runs from qTest Manager

  6. Execute Tests - Execute Test Runs on device

  7. Upload Tests -Upload Test Logs to qTest Manager

  8. Remove Tests - Remove Test Runs from qTest App

  9. Log Out

Additional Flow

  • Re-download Tests - Re-download Test Runs from qTest Manager

  • Sync Up Left Navigation Panel with qTest Manager

Key Features

Log in

Log in using your qTest Manager URL, username, and password.

Internet connection is required for this feature.

Log in Step 1: Open qTest App application on the device, and then provide qTest Manager domain. Click Continue.

Log in Step 2: Provide Username and Password. Click Log In to authenticate.

Navigation

The top left Project Menu will display the list of projects that you have access to in qTest Manager. Click on the Project Menu then select your working project.

Only the projects in which you are granted with "View Test Runs" permission are included in the drop-down.

View Test Run Information

In the left navigation panel, select the Test Run name to display its information on the right panel.

You can view the following Test Run details:

  • Test Case Details

  • Test Run Properties

  • Attachments

Download Test Runs from qTest Manager

Before executing a Test Run, you must first download it from qTest Manager. In order to download Test Runs, you are required to be in Online Mode.

Notes

  • Internet connection is required for this feature.

  • "Approve Test Cases" permission is required.

The Download button is found in two areas:

  • Download action button located at the top of the left navigation panel. This button can be used when selecting releases, test cycles, test suites, or specific test runs on the left navigation panel to download multiple test runs. You're allowed to select up to 2,000 test runs to download with this button.

  • Download button on the Test Run page. This button can be used to download the current view test run.

When a Test Run is downloaded, it contains the most recent information about the Test Case and Test Run at that point in time. The circle indicator, next to the Test Run name in the navigation panel, will change from a white circle with an arrow to a gray circle.

The qTest App will always download the latest approved Test Case version.

  • If you are downloading a Test Run and you have"Approve Test Cases" permission in that project, then the latest version will be approved and downloaded.

  • If you are downloading a Test Run and you do NOT have "Approve Test Cases" permission in that project, then the latest approved version will be downloaded.

Refresh (Re-download) Test Runs from qTest Manager

If you click Refresh button to re-download a Test Run that was previously downloaded and not yet executed, then the qTest App will re-download and show the latest Test Run information without a message.

If a Test Log was saved (but not yet uploaded), when you click Download or Refresh, a pop-up message will display that reads: “Refreshing this Test Run will lose your changes. Are you sure you want to proceed?” (Yes) (No)

Notes

  • Internet connection is required for this feature.

  • "Approve Test Cases" permission is required.

Execute Test Runs

To execute Test Runs, you can input Test Log information into a downloaded Test Run including:

  • Add Test Log status (such as passed, failed, etc)

  • Add Test Step actual result and Test Step status (such as passed, failed, etc) for each test step.

    To quickly enter the status, you can “Mark Selected Steps” test steps and the test log as the same status.

  • Add Notes (remember to click Save button after entering the Note).

  • Upload attachments to the Test Log

Notes

You cannot perform these functions in the qTest App:

  • Modify Test Case or Test Run fields

  • Upload attachments to test step logs

  • Upload attachments to Test Cases

  • Submit Defects

A Test Run can only be executed once in the qTest App before it’s uploaded, meaning that only one test log can be saved for the test run at a time. You can open an executed log and modify it as long as the changes are saved before the log is uploaded to qTest Manager.

If the test log was already saved, you can modify the test log and save (should be considered one test log, not a separate test log).

Upload Test Logs to qTest Manager

When switched back to Online Mode, a pop-up is displayed to confirm you would like to upload the executed test logs. “Would you like to upload the executed test logs?” Alternatively, you can also manually select specific test logs to upload. You're allowed to select up to 2,000 test logs to upload.

Once uploaded, test logs are added to the execution history of the test runs from which they were originally downloaded. Immediately after the test logs are uploaded, those test runs are automatically removed from the device. When a test log is uploaded to qTest Manager, the Test Run in qTest Manager will display these time stamps:

  • Executed Start time= when the test log is modified locally for the first time, not during the downloading of the test run.

  • Executed End time= when the test log is modified locally for the final time, not during the uploading of results.

After the test log is uploaded to qTest Manager, the test run must be re-downloaded in order to be executed again on the device (which then be saved as a separate test log).

Notes

  • Internet connection is required for this feature.

  • "Edit Test Runs", "Execute Test Runs" permissions are required.

Remove Test Runs from qTest App

After successful upload of Test Logs, the Test Runs will be removed from the device. You can also manually remove Test Runs from the device at any time. Removing the Test Runs from the device will not delete the Test Runs in qTest Manager.

Sync Up Left Navigation Panel with qTest Manager

The left navigation panel in qTest Manager will not be synced real time to qTest App for now. In case there are new objects (releases, test cycles, test suites, or test runs) created in qTest Manager, you can select the Refresh button on the left navigation panel to sync up with qTest Manager.You are required to be in Online Mode to have sync feature works.

Internet connection is required for this feature.

Log out

You can log out to end your session in qTest App. After logging out, you need to have internet connection in order to log in. Log out button can be found when you click or hover on the user name.