Work with test runs and test cycles

In Tricentis Test Management for Jira, you use test runs to document the execution of a test case. They contain all the information about the execution state and test result of test steps at a given time. For that reason, you can have multiple test runs for the same test case.

To group your test runs into different categories, you use test cycles. These work like folders that help you organize your tests. For instance, these can be features, a specification, or any area of your development cycle.

Test cycles and test runs

Usually, test cycles are assigned to a product version. This can be one of the versions (releases) you have in your Jira project. If you don't work with product versioning, you have the option to leave a test cycle unversioned.

This topic takes you through the steps to work with test cycles and test runs.

Create test cycles

You can create test cycles in one of the following ways:

Link existing test cycles to issues

As described above, you can create empty test cycles that are already linked to any Jira issue, except for test cases. But, if you already have a test cycle, you can still link it to an issue to track the connections between your testing needs and your test runs:

  • In the Test Execution tab, open an existing test cycle and select Link to issue. From here, you can attach as many Jira issues as you need to.

  • Go to the Jira issue you want to link to a test cycle and select Cycle Traceability, then select the project that contains the test cycle you want to attach. From here, you can attach as many test cycles as you need to.

Create test runs for a test cycle

To run your test cases in Tricentis Test Management for Jira, you need to create a test run for every test case you want to execute. Test runs are stored in test cycles, which you need to create before proceeding.

Note that you can select multiple test cases and use the floating actions bar to quickly create a test run.

To create test runs for an existing test cycle, follow these steps:

  1. In the Apps section of your Jira project, select Test Management to open the Tricentis Test Management for Jira.

  2. Go to the Test Design tab.

  3. Select the checkboxes next to the test cases that you want to create test runs for.

  4. Select Create test run.

    Note that you can also create and view test runs for an individual test case in the Test Case Panel.

  5. In the subsequent dialog, choose Select an existing test cycle.

  6. Fill out these details:

    • Select version: specify the version (release) for this test cycle. If you don't work with product versioning, choose Unversioned.

    • Select an existing cycle/folder: choose the test cycle or folder you want to add these test runs to. You can only choose test cycles which are assigned to the specified version.

    • Assign cycle's test runs to a tester: specify a Jira user to assign these test runs to. This is optional.

    • Environment: select the test run environment from the dropdown. This is optional.

    • Build: select the build from the dropdown. This is optional.

  7. Select Done.

Note that you can define the Build and Test run environment dropdown options in Settings.

You can also create test runs directly from a requirement, which helps focus your testing on the requirements you've already set.

Organize test cycles with folders

If you have a large number of test runs in your test cycles and are finding it hard to keep a good overview, add an additional organizational layer: folders within your test cycles.

To add a folder to a test cycle, follow these steps:

  1. Go to the Test Execution tab and hover over the test cycle in the list.

  2. Select > New Folder and follow the instructions on the screen.

  3. To add one or more test runs to the folder, select them. Then select Move to folder from the floating actions bar.

Each folder has its own menu, where you can do these things:

  • Rename or delete the folder.

  • Create subfolders.

  • Clone the folder. This creates a duplicate of the folder and its contents in the same test cycle.

You can also drag and drop folders within the same test cycle. For example, to change their order or move them into a different parent folder.

Bulk update test runs

Whether you need to update the status of multiple test runs, or change who executed them, you can bulk update your test runs from within Tricentis Test Management for Jira.

If you need to make updates to more than one test run at a time, follow these steps:

  1. Go to the Test Execution tab.

  2. Select the test cycle you want to modify.

  3. Select the checkboxes next to the test runs that you want to update one or more fields in.

  4. Select Edit from the floating actions bar.

  5. In the subsequent dialog, choose the Attribute to update and then what to Replace current value with.

    You can update any of the following fields: Assignee, Components, Executed by, Planned dates, Priority, Status, Build, or Test run environment.

  6. When you're done with all the fields, select Update to finish.

Note that you can update all fields for test runs from within Tricentis Test Management for Jira, but you can't use the Jira bulk update function for test runs.

Clone test runs

Do you need to re-run a test? Maybe your last test run failed. Or, you want to copy a test run before you edit a few steps, so you don't have to start from scratch.

To quickly duplicate an existing test run, navigate to the Test Runs tab on the Test Case. Hover over the test case you want to clone to see the menu, then select Clone from the menu.

The test run you selected copies to a new test run with the same steps, settings, and attachments.

Delete test runs

No one's perfect. Maybe it was an inaccurate testing scenario, or maybe it was just a duplicate. Whatever the case is, we've made it easy to find and delete test runs you no longer need.

Delete test runs from a test cycle

To delete test runs from a test cycle, follow these steps:

  1. In the Apps section of your Jira project, select Test Management to open Tricentis Test Management for Jira.

  2. Go to the Test Execution tab.

  3. Select the test cycle you want to modify.

  4. Select the checkboxes next to the test runs that you want to delete.

  5. Select to delete the test run.

Delete test runs from a test case

To delete test runs from an individual test case, follow these steps:

  1. In the Apps section of your Jira project, select Test Management to open Tricentis Test Management for Jira.

  2. Go to the Test Design tab.

  3. Select the test case you want to modify and go to the Test Runs tab.

  4. Select the checkboxes next to the test runs that you want to delete.

  5. Select to delete the test run.

Test cycle execution data

You can additionally track test execution data directly from test cycles. It allows you to see test results of all test runs in this test cycle:

  • Total Test Runs: displays the total number of test runs in the test cycle.

  • Executed: displays the total number of test runs which you already executed.

  • Unexecuted: displays the total number of test runs which you didn't execute yet.

  • Status bar: graphically distributes test runs of the test cycle according to their status.

Overview of test cycle execution data

Filter your test runs

Sometimes, you need to focus on a small part of the bigger picture. In this case, use Filters to investigate specific test runs.

To filter your test runs, follow these steps:

  1. In the Test Execution tab, select Filters.

  2. Select Add filter.

  3. Chose a parameter from the dropdown list. For example, you could filter test runs by Priority.

  4. Select your chosen filter type to drill down further. For example, you could now filter for any test runs that are labeled as High Priority.

Save filters

If you find yourself applying the same group of filters over and over, save yourself some work in the future. Just apply your filter(s), select Save filter, and follow the prompts on the screen. You can access all saved filters any time via the button.

Share your test runs

Data isn't as useful if you're the only one that sees it. You can easily share your test run versions and cycles:

  • To share test versions, cycles, or folders with people who have access to your Jira project, give them the URL of your test run version, cycle, or folder.

  • To share test cycles with people who don't have access— or people who just prefer to have an Excel file— just open the test cycle you want to share. Then, select and Export.

What's next

Now that you have your test cycles and test runs, check out how you can work with them.