qTest App for Windows User Guide

The qTest App for Windows is a native application that allows testers to execute tests outside of the full browser-based experience of qTest Manager. This product is suitable for testers who need to test in non-traditional environments including areas without access to the internet or their OnPremise network. Under these conditions, testers are unable to access qTest Manager through their browser but still need to perform their tests and track their results.

Even if a tester can access the internet, he or she may not actually want to use qTest Manager. The qTest App's simplified experience strips down all the "bells and whistles" of qTest Manager, which makes it easier for QA Leaders to incorporate Non-QA Testers into their testing projects. Non-QA Testers benefit from an experience that focuses on just Test Execution without becoming overwhelmed by the full qTest Manager UI. QA Leaders benefit from a wider group of participants in their testing projects.

Login

Log in using your qTest Manager URL, username, and password. After you are logged in:

  • The qTest App will remember qTest Manager URL. You will not have to re-enter in the URL for future log-in

  • If you’re switched to Offline Mode, your credentials will be retained.

  • Internet connection is required for this feature.

LDAP and SSO account are currently not supported yet. Only qTest account should be used.

Step 1

Open qTest App application on the device then provide qTest Manager domain. Click "CONTINUE"

Step 2

Provide Username and Password. Click "LOG IN" to authenticate or "BACK" to return to qTest Manager domain page.

Navigation

The top left Project Menu will display the list of projects that you have access to in qTest Manager.

Only the projects in which you are granted with "View Test Runs" permission are included in the drop-down.

Offline Mode vs Online Mode

Offline Mode

Once logged in to the qTest App, if internet connection is no longer detected, the application will automatically switch to Offline Mode. In Offline Mode, the left navigation panel will only display Test Runs that were downloaded.

In Offline Mode, you can perform a limited set of actions including:

  • View details of downloaded Test Runs

  • View the "Downloaded Test Status" bar graph which will update statistics pertaining to Test Run downloads and Test Run executions.

  • Execute Test Runs (saving Test Logs)

  • Remove Test Runs from the application (this removes the Test Runs from the device only)

The Offline/Online toggle pictured above is not a button to switch between Offline and Online modes. Once logged in to the qTest App, and an internet connection is no longer detected, the application will automatically switch to Offline Mode. To manually switch to Offline mode, you need to disable the internet connection on your device. To enter back into Online mode, make sure you are connected to the internet. To switch to Offline mode, disconnect from the internet.

Online Mode

When an internet connection is restored, a banner is displayed which suggests you to manually switch to Online Mode. In Online Mode, the left navigation panel will display all Test Runs in that project, including non-downloaded Test Runs as well as those that were previously downloaded.

In Online Mode, you have the following actions:

  • View details of non-downloaded and downloaded Test Runs

  • Download Test Runs

  • Upload Test Runs

  • View details of downloaded Test Runs

  • Execute Test Runs (saving Test Logs)

  • Remove Test Runs from the application (this removes the Test Runs from the device only)

View Test Run Information

In the left navigation panel, select the Test Run name.

You can view the following Test Run details:

  • Test Case Details

  • Test Run Properties

  • Attachments

Download Test Runs from qTest Manager

Before executing a Test Run, you must first download it from qTest Manager. In order to download Test Runs, you are required to be in Online Mode.

Notes:

  • Internet connection is required for this feature.

  • "Approve Test Cases" permission is required.

The Download button is found in two areas:

  • Download action button located at the top of the left navigation panel. This button can be used when selecting release(s), test cycle(s), test suite(s) or specific test run(s) on the left navigation panel to download multiple test runs. You're allowed to select up to 2000 test runs to download with this button.

  • Download button on the Test Run page. This button can be used to download the current view test run.

When a Test Run is downloaded, it contains the most recent information about the Test Case and Test Run at that point in time.

Test Runs that have not been executed:

  • Downloaded Test Run: Test Runs that have been downloaded, yet not executed will display a large gray circle as a visual signifier of the Execution Status of the current Test Log in the qTest App before it's uploaded to qTest Manager. The color of the small circle shows the Last Execution Status from qTest Manager.

  • Non-downloaded Test Run: Test Runs that have not been downloaded will display a large, white circle with a gray down-arrow as a visual signifier that the Test Run can be downloaded. The color of the small circle shows the Last Execution Status from qTest Manager.

The qTest App will always download the latest approved Test Case version.

  • If you are downloading a Test Run and you have"Approve Test Cases" permission in that project, then the latest version will be approved and downloaded.

  • If you are downloading a Test Run and you do NOT have "Approve Test Cases" permission in that project, then the latest approved version will be downloaded.

Refresh (Re-download) Test Runs from qTest Manager

If you click the "Refresh" button to re-download a Test Run that was previously downloaded and not yet executed, then the qTest App will re-download and show the latest Test Run information without a message.

If a Test Log was saved (but not yet uploaded), when you click “Download / Refresh,” a pop-up message will display that reads: “Refreshing this Test Run will lose your changes. Are you sure you want to proceed?” (Yes) (No)

Notes:

  • Internet connection is required for this feature.

  • "Approve Test Cases" permission is required.

Execute Test Runs

To execute Test Runs, you can input Test Log information into a downloaded Test Run including:

  • Add Test Log status (such as passed, failed, etc)

  • Add Test Step actual result and Test Step status (such as passed, failed, etc) for each test step

    To quickly enter the status, you can “Mark Selected Steps” test steps and the test log as the same status

  • Add Notes (remember to click Save button after entering the Note)

  • Upload attachments to the Test Log

Test Runs that have been executed:

  • Downloaded Test Run: The color of the large circle is a visual signifier of the Execution Status of the current Test Log in the qTest App before it's uploaded to qTest Manager.The color of the small circle shows the Last Execution Status from qTest Manager.

  • Non-downloaded Test Run: The large circle is white, with a gray download icon to indicate that the Test Run must first be downloaded to the qTest App in order to be executed. The color of the small circle shows the Last Execution Status from qTest Manager.

Notes:

You cannot perform these functions in the qTest App:

  • Modify Test Case or Test Run fields

  • Upload attachments to test step logs

  • Upload attachments to Test Cases

  • Submit Defects

A Test Run can only be executed once in the qTest App before it’s uploaded, meaning that only one test log can be saved for the test run at a time. You can open an executed log and modify it as long as the changes are saved before the log is uploaded to qTest Manager.

If the test log was already saved, you can modify the test log and save (should be considered one test log, not a separate test log).

Upload Test Logs to qTest Manager

When switched back to Online Mode, a pop-up is displayed to confirm you would like to upload the executed test logs. “Would you like to upload the executed test logs?” Alternatively, you can also manually select specific test logs to upload. You're allowed to select up to 2,000 test logs to upload.

Once uploaded, test logs are added to the execution history of the test runs from which they were originally downloaded. Immediately after the test logs are uploaded, those test runs are automatically removed from the device. When a test log is uploaded to qTest Manager, the Test Run in qTest Manager will display these time stamps:

  • Executed Start time = when the test log is modified locally for the first time, not during the downloading of the test run

  • Executed End time = when the test log is modified locally for the final time, not during the uploading of results.

After the test log is uploaded to qTest Manager, the test run must be re-downloaded in order to be executed again on the device (which then be saved as a separate test log)

Notes:

  • Internet connection is required for this feature.

  • "Edit Test Runs", "Execute Test Runs" permissions are required.

Remove Test Runs from qTest App

After successful upload of Test Logs, the Test Runs will be removed from the device. You can also manually remove Test Runs from the device at any time. Removing the Test Runs from the device will not delete the Test Runs in qTest Manager.

Sync Up Left Navigation Panel with qTest Manager

The left navigation panel in qTest Manager will not be synced real time to qTest App for now. In case there are new objects (releases, test cycles, test suites or test runs) created in qTest Manager, you can select Refresh button on the left navigation panel to sync up with qTest Manager.You are required to be in Online Mode to have sync feature works.

Internet connection is required for this feature.

Logout

You can log out to end your session in qTest App. After logging out, you need to have internet connection in order to log in. Logout button can be found when you click or hover on the user name.

Upgrades

Auto-check for Newer Versions

When you have an internet connection, you will be automatically notified whenever a new application version is available. This will only occur as you re-open the app and will not disrupt testing processes.

The qTest app will not automatically update. Once you receive the automatic notification, you can manually choose to upgrade.

Manually Check for Newer Versions (Versions 1.2.1 and Beyond)

You can also manually check for newer versions. To do so, follow these steps:

  1. In the qTest App, select the Question mark icon.

  2. Select Check for Updates.

If there is an update available, you will be met with a dialog saying so. If not, you will be told that there is no new version available.

Close App

You can temporarily close qTest App. After closing the app, user is not required to have internet connection in order to access qTest App next time as last user login credential will be used.

Closing the app will not log you out