Manager 8.2 Release Notes

December 27, 2016

'qTest' is now 'qTest Manager'

If you have visited QASymphony.com lately, you might have noticed a change in the name for our test case management tool qTest.  When QASymphony first Launched qTest. we had a vision to bring more agile testing tools to market for our customers.  Over the past few years, we have added qTest Explorer, qTest Scenario. and qTest Insights to be apart of the qTest Platform.  As we continue to add new testing products, the new name of qTest Manager will standout as the powerful, easy-to-use test case management solution apart of the qTest Platform. 

In future releases, our customers will see some new UI changes for qTest Manager similar to the new UI for qTest Sessions and qTest Parameters modules. 

New Features - Improved Workflows and Test Parameters

Create Test Run(s) from a Test Case

  • Previously, there was only one way to create Test Runs (from Test Execution). Now, there is a second option to create Test Run(s) directly from the Test Case in Test Design. Click on the new Create Test Runs button and select the Test Execution location (such as within a specific Test Suite) to create the Test Run(s)

qTest Parameterization 

  • qTest features a new module, qTest Parameters. to manage testing data. It is available for Premium and Elite users. You can now include parameters in Test Cases and also define parameter values to create Test Runs

  • To access to the new module, select qTest Parameters from the 9-box icon in the top-right corner of the qTest header

qTest Parameters works best on the latest versions of Chrome, Firefox, Safari 9 & 10, and IE11. You may receive the following "Outdated Browser" page, if you open qTest Parameters in Safari versions before 9, or IE versions before 11. 

Parameters 

Landing qTest Parameters via the 9box, the Parameters page provides you with a list of parameters which belong to all qTest Manager's projects you have access to.

Functionalities on the Parameter Grid 

  • Search the parameters by their identifier. This is a contain-search which means it finds all parameters' identifiers that contain your typing-words

  • Filter parameters by their assigned projects, status (active/inactive), used/unused (in either a Test Case or a Dataset)

  • Sort parameters by most recent, A-Z, Z-A

  • Clear All Filters

  • Pagination

  • Export multiple selected parameters

  • Archive multiple selected parameters

Create a Parameter 

  • This feature helps create a new parameter, assign it to desired projects, and add parameter values

  • Create Another: Once this option is on, it will retain the Create Parameter window so you can easily continue to create more parameters

  • Use the Hot-key: Shift-Enter to quickly create the parameter

Import Parameters

  • This feature allows user to import multiple parameters and their values into certain projects, using a .xls or .xlsx file (Maximum Size: 10MB)

  • Template of the import file is provided as a guide

  • Drag and drop the file or select the import file from your directory

  • If there are duplicate parameters (such as if a parameter in the import already exists in qTest Parameters), there are 3 options: 1) Overwrite duplicates parameters 2) Add data to existing parameters or 3) Skip duplicate parameters

  • Import Result dialog shows the number of successful imported parameters, number of failures, and also the list of parameters that failed to import successfully

  • Import Result dialog shows the number of successful imported parameters, number of failures, and also the list of parameters that failed to import successfully

Edit a parameter 

  • Ability to edit a parameter's details like identifier, description, status, projects

  • Ability to add/edit/archive parameter's values 

  • Ability to search/sort parameter's values 

  • Test Cases Tab: Provide a list of Test cases which are using the parameter. User can click on either Test case ID or Test case name to open it in a new browser tab

  • Datasets Tab: Provide a list of Datasets which are using the parameter. User can click on the Dataset Name to open the Dataset Profile page in a new browser tab

Archive a parameter 

  • Provide ability to temporarily delete a parameter.

  • There is a daily job to permanently remove 30-day archived parameters out of the system

  • Warn user if he wants to delete (archive) a parameter which is used by a Test case. Archive parameter if user confirms.

  • Not allow a parameter to be archived if there is a Dataset using it

Datasets 

Click on the Datasets tab from the qTest Parameters page to see a grid of all datasets

Functionalities on the Datasets Grid 

  • Search the datasets by their name. This is a contain-search which means it finds all datasets' names that contain your typing-words

  • Statistic number on top of the grid quickly tells how many datasets are active/ inactive

  • Filter datasets grid by their status (active/inactive)

  • Sort datasets grid by most recent, A-Z, Z-A

  • Pagination

  • Delete multiple selected datasets

Create a Dataset

This feature helps create a new dataset with basic information and a large amount of data.

Create Dataset and manually select data for each data row

  • Build Dataset structure: specify parameters to become Dataset columns (A Dataset can have 25 columns as maximum)

  • Ability to add either one row or a bunch of rows (maximum: 25 rows/time) into the Dataset

  • Remove unwanted columns/rows

  • Prepare data for the dataset by select value for every cell

Generate data automatically

  • 2 methods/algorithms to automatically generate data:

    • Unique Values: Parameter values will not be repeated, no 2 rows will have the same parameter value

    • Unique Combinations: Each row in the data grid will contain a unique combination.  Parameter values can be repeated, however, no 2 rows will have the same combination of data. (Maximum number of combinations can be generated is 1 million)

Clear data

  • Clear Values: All values/data of the Dataset will be cleared out, but its structure (selected columns) remains unchanged.

  • Reset Table: Dataset's structure and data are all removed. The Dataset turns back to its initial state where user can reBuild it from scratch.

Edit / Delete a Dataset

From the Dataset Grid page, click on a Dataset name to open its profile page. This view provides following functionalities:

  • Ability to edit a parameter's details like name, description, status

  • Ability to add/edit/delete dataset's structure and content

  • Ability to automatically generate data for the dataset

  • Ability to delete a dataset: allow a dataset to be deleted even if it is being used in qTest Manager

Using qTest Parameterization 

Parameterization Settings

In order to use Parameters in a qTest project, the feature needs to be activated under the project level settings. It is activated by default for all projects. If you plan not to use parameters in your project, please switch it off.

Design Test Cases with parameters

  • In qTest Parameters. your parameters need to be assigned to your qTest project so they can be added to your Test Cases

  • Currently, you can only add parameters in Test Step Description. Type the parameter name following @ which will provide a selection and then select one of the parameters from the drop down list (such as @Month)

It is highly recommended that you only add up to 25 parameters in one Test Case.

Create Test Runs from Test Cases with parameters

Currently, qTest does not allow the user to select the parameter value when executing the Test Run. Therefore, the parameter values must be specified first when creating the Test Run.

  • In addition to creating Test Runs from Test Execution tab, we provide another way for you to create Test Runs from a specific Test Case

  • If a Test Case includes parameters, qTest will prompt you to assign parameter values in order to create Test Runs. If a Test Case includes inactive or deleted parameters, you cannot create any new Test Runs

  • You can create up to 100 Test Runs with different parameter values from a Test Case at a time

  • There are 3 ways for you to assign parameter values when creating Test Runs: Manually, Randomize data, and From Dataset

  • Manually: Manually select parameter values one by one

  • Randomize data: System randomly selects parameter values. You can choose one of these 2 options:

    • Unique Data Combinations Only: Each Test Run will contain a unique combination. Parameter values can be repeated, however, no 2 rows will have the same combination of data

    • Unique Values Only: No 2 rows will have the same parameter value

    For both 2 options, qTest only supports selecting 100 data combinations from up to 2 billion available data combinations. If there are more than 2 billion available combinations, randomizing data may be slow.

  • From Dataset: use pre-defined data from Dataset(s) to create Test Runs

Executing Test Runs

  • A Test Run is not executable if its associated Test Case version includes a parameter that is inactive, deleted, or does not have any values. Parameters without assigned values are highlighted in red

  • You can click on highlighted parameters to select their values

Once you select a parameter value, you will not be able to change it. It is a known issue.

Enhancements

  • API sessions will not count towards your qTest session limit. This applies to both session limits: 1) Max 3 sessions per user and 2) Max concurrent sessions per account (if subscription is based on concurrent license model)

  • Test Case creator and Test Run creator information is included in the following API

    • Get all Test Cases under Root/Module

    • Get Test Case by ID

    • Get Test Case by Test Case Version Id

    • Get all Test Runs under Root/Release/Test Cycle/Test Suite

    • Get Test Run by Id

Known Issues and Limitations

  • Although qTest supports creating 100 Test Runs with parameters at a time, it is highly recommended to create up to 50 Test Runs only, or you may experience a slow page loading

  • qTest does not support cloning projects with parameters

  • Test Run Configurations cannot be applied to Test Runs created from Test Cases with parameters

  • In TestPad, you are not able to edit Test Step Description and Expected Result of Test Runs with parameters

  • When assigning parameter values in Test Runs, once you select a parameter value, you will not be able to change it

  • Once you correct parameters in a Test Run to make it executable, you will need to reload the Test Run page so you can see the Run/Quick Run button

  • Once you re-activate parameters in a Test Case to create Test Runs, you will need to reload the Test Case page so you can see the Create Test Run button

  • Resetting the Sample Project in qTest Manager will not remove the association between sample Test Cases and parameters. In qTest Paramaters, clicking on an associated sample Test Case which has been reset will direct you to an error page in qTest Manager

  • You are not able to batch update Test Case Version of Test Runs whose parameters have not been assigned with values

  • When performing free text or free text search, parameter IDs and parameter value IDs are displayed in the search result panel, instead of the parameter names and values

  • It takes 5 minute to sync up between qTest Manger and qTest Parameters if there are any changes to the qTest Manager project that includes parameters

  • Feature "Automatically generate data" is currently based on every value included in a parameter. The system will skip the parameter's value-duplicated validation. Therefore, if a parameter has duplicate values, "Automatically generate data" may create rows with duplicate data

  • Order of datarows in Dataset are changed after manually creating a new Dataset.

qTest Sessions Enhancements

Keep column headers floating when scrolling down the session list

Reorder columns in session list view

To reorder a column, open Customize View and drag the column to new position. Click OK for the change to take effect.

Show Session history in detail and review page

Change histories of a session is shown in the session detail and session review (Completed session only) page.

Sessions Bug Fixes

  • Review page does not respond after editing screens then opening Generate Script then Save session