Configure test results folders

To execute TestEvents with Distributed Execution with AOS (Automation Object Service), you must first create and configure at least one ExecutionList folder in Tosca Commander. This is where Tosca Distributed Execution saves the test results.

To do so, follow the steps below:

  1. Create the new properties ContinuousIntegrationBuildRootFolder and ResultFolder. You only need to do this once for each repository.

  2. Create the default test results folder.

By default, Tosca Commander automatically saves the test results in your default test results folder. For more information on this process, see chapter "How test results are saved".

Optionally, you can configure Tosca Commander to save the test results of different TestEvents to different test results folders. For this, you need to configure several test results folders and specify for each TestEvent in which folder the test results should be saved.

To do so, follow the steps below:

  1. Create as many additional test results folders as you need.

  2. Specify a test results folder for each TestEvent whose test results you want to save in a folder other than the default folder.

Create new properties

  1. In Tosca Commander, open the workspace which has access to the common repository.

  2. Open the Project window via Home->Project.

  3. Check out the project root element.

  4. Open the Properties definition tab.

Properties definition tab

  1. Right-click Folder and select Create Property from the mini toolbar.

Create a new property for Folder

  1. Rename the newly created property to ContinuousIntegrationBuildRootFolder.

  2. Enable the Visible checkbox.

ContinuousIntegrationBuildRootFolder property for all ExecutionLists folders

  1. If you see the TestEvent element in the list, continue with step 9. If you do not see this element, right-click the project root element and select Create property definition->TestEvent from the context menu.

  2. Right-click TestEvent and select Create Property from the mini toolbar.

  3. Rename the newly created property to ResultFolder.

  4. Enable the Visible checkbox.

Create the default test results folder

The default test results folder is where Tosca Commander saves the results from TestEvents for which you do not specify a test results folder.

To create the default test results folder, follow the steps below:

  1. Go to the Execution section.

  2. Create a new ExecutionList folder.

  3. In the Properties pane of the newly created folder, set the property ContinuousIntegrationBuildRootFolder to True.

Set ContinuousIntegrationBuildRootFolder to True

Change the default test results folder

If you want to change the default test results folder, follow the steps below:

  1. For the old default test results folder, delete the value True from the property ContinuousIntegrationBuildRootFolder.

  2. Go to the new default test results folder and set the value True for the property ContinuousIntegrationBuildRootFolder.

Tosca Commander now saves the results to the new folder by default.

Create an additional test results folder

To configure an additional test results folder, follow the steps below:

  1. Go to the Execution section.

  2. Check out the Execution project.

  3. Create a new ExecutionList folder.

  4. In the Properties pane of the newly created folder, enter any value for the property ContinuousIntegrationBuildRootFolder that is different from what you have already set for other test results folders.

Specify the test results folder for a TestEvent

To specify the folder where Tosca Commander should save the results of a TestEvent, follow the steps below:

  1. Go to the Execution section.

  2. Select the test results folder where you want to save the results from the TestEvent.

  3. In the Properties pane of the test results folder, copy the value of the property ContinuousIntegrationBuildRootFolder.

  4. Check out the TestEvent.

  5. In the Properties pane of the TestEvent, set the value of the property ResultFolder to the same as the value of the property ContinuousIntegrationBuildRootFolder of the test results folder.

If you do not specify the test results folder for a TestEvent, its test results will be saved in the default test results folder.

How test results are saved

As soon as the system finishes a test run, it automatically creates a subfolder within the test results folder for each TestEvent. The subfolder's name consists of the name of the TestEvent and a time stamp.

Within this folder, Tosca Commander creates a TestMandate for each ExecutionList in the TestEvent. The TestMandate has the same name as the corresponding ExecutionList.

After the execution of the TestEvent finishes, the system saves the test results in these TestMandates.

Results from multiple test runs in Sample results folder