Using Analysis Reports

qTest Insights provides several pre-built, cross-project reports that can be viewed from three different perspectives including Quality, Coverage, and Velocity.

Using Analysis Reports

To begin, you should set your Global Filter for the criteria you would like to view:

Select the Global Filter icon to choose one or more values for Projects, Test Cycles, Modules, and Releases to filter your Analysis report data. Any change to the criteria will affect the entire report view.
You can set a global value to automatically refresh data at your expected interval of either 1,2,5,10 or 20 minutes.
Select the Refresh Now icon to automatically reload your reports with the latest data.
Select the Save Report icon to save each Analysis report to the Manage Reports section of qTest Insights. This will allow you to manage or schedule the report later on.
Read the Saved Reports article on how to manage and schedule report.

Quality Analysis

Below are some helpful tips for navigating the Quality Analysis report.

From the menu Analysis menu, select Quality to open the Quality Analysis page.

There are three quality charts:
- Latest Test Run Results: the results from the latest Test Runs of each Test Case.
- Test Results by Day: a breakdown of the Test Run results by day.
- Defect Status: shows the distribution of Defects by status.
Click on each tab to show data broken down by project, and Test Cycle.

Hover to See Data

When you hover over the green pie slice, a small pop-up will display telling you that there are 30 defects.

Click to Drill-down for Details

Read this article for things you are able to do on a drill-down page.

Coverage Analysis

The Coverage Analysis report helps you determine test case and execution coverage as it related to requirements and application areas. Below are some helpful tips on navigating the Coverage Analysis report.

Overview

From the Analysis menu, select Coverage to open the Coverage Analysis page.

Coverage Analysis Charts

Requirements Test Run Coverage: The heat map is set up so that the size of each box is based on the number of Test Runs and the color of the box is based on the number of failed runs. Dark green is the lowest number of failures and bright red is the highest number.
Requirements Run Results: The results from the latest Test Run of each Test Case covering the Requirements.

Use the Coverage Table

Test Type: allows you to filter out manual vs automation Test Run data for the analysis data table.

Analysis Data Table: This table shows the Test Cases for each requirement along with the testing results and number of Defects. The followings are some explanations for several fields in the table.
Explorer Sessions: the count of Explorer Sessions associated with a specific Test Case and Requirement. (An Explorer Session must be linked to a Test Run which then linked to a Requirement to be counted.)
Explorer Time: total time spent in Explorer sessions associated to a specific Test Case and Requirement
Open Defects (qTest): the count of qTest Defects whose status are either New, Reopened, or Assigned
Severe Defects (qTest): the count of qTest Defects whose severity are either Fatal, or Major

Hover to View Data

When you hover over the cell of Requirements Test Run Coverage, a small popup displayed telling you that the Requirement US_Login has been covered by 6 Test Runs and 3 of them failed.

Click on Heat Map to Drill-down to Details

Velocity Analysis

The Velocity Analysis reports show how fast the team is going and how much work might be left to do. Below are some helpful tips on navigating the Velocity Analysis report.

From the Analysis menu, select Velocity to open the Velocity Analysis page.

There are three velocity metrics as follows:

Test Planned vs. Executed: cumulative results by day for the # of tests planned & executed & execution results. The Date Range Selector is available to display the start and end dates for the selected Release(s). If multiple Releases are selected in the Global Filter, then the date range displayed will be the earliest start date and the latest end date for the selected Releases.

New Requirements and Test Cases: # of Requirements and Test Cases (manual & auto) added by day.

Defects Opened and Closed: # of Defects opened and closed by day.

Analyzed Data Table: shows activities and results broken down by testers.

Estimated Time Remaining: calculated based on the measured time spent by tester per Test Step and the number of Test Steps remaining.

Forecasted Defects Remaining: calculated based on the number of Defects found by tester per Test Run and the number of Test Runs remaining.
Explorer Sessions: the count of Explorer sessions conducted by the tester
Explorer Time: total time of Explorer sessions conducted by the tester

Hover Over Charts to See Data

When you hover over a point on the Tests Planned vs. Executed chart, a small popup displayed telling you that there are 27 passed Test Runs on 8/25/2016.

Click Data Points of Charts to Drill-Down