Scan controls with Tricentis Vision AI

To scan your controls with Vision AI, follow the steps below:

  1. In Tosca Commander, open Tosca XScan via Modules->Scan->Application.

  2. In the Select Application window, right-click the application that you want to scan and select Vision AI from the context menu.

Vision AI option in XScan

  1. Click Scan.

  2. Select your controls and save the Modules.

    Alternatively, you can optimize the scan results before you save the Modules:

  3. Create your TestSteps from the Modules and execute your tests.

Change the control type

Vision AI recognizes several different types of controls. The steering mechanism varies from type to type. For optimal steering, you can adjust the control type to best match your actual control. To do so, follow the steps below:

  1. In XScan, select your control and switch to the Advanced View.

  2. In the Identify by Properties pane, go to Technical properties.

  3. For the ControlType property, select a new control type from the drop-down list. XScan displays only the control types that Vision AI detected for this specific control.

ControlType property in XScan

  1. Save your Module and close the XScan window.

Change the control type via the TreatAs parameter

If Vision AI doesn't detect the correct control type, you can change it manually in the technical properties of the control in XScan.

To do so, follow the steps below:

  1. In XScan, select your control and switch to the Advanced View.

  2. In the Identify by Properties pane, click Load all Properties.

  3. As Value of the technical parameter TreatAs, select the control type that you want to use. You can select one of the following values:

    • Button

    • CheckBox

    • Dropdown

    • Icon

    • Input

    • List

    • Menu

    • RadioButton

    • TabBar

    • Table

    • Text

    • ToolBar

    • Tree

    • Window

In this example, you instruct Vision AI to steer the Engine Performance control as a Dropdown even though it was identified as an Input.

TreatAs technical parameter

Change the control label

The optical character recognition (OCR) mechanism of Vision AI might sometimes make spelling errors in label names. Vision AI uses fuzzy matching when it matches the OCR text against label values, so it is best if you have an accurate label value for the OCR matching algorithm to work with.

You can adjust label names to best match the actual label of a control. To do so, follow the steps below:

  1. In XScan, select your control and switch to the Advanced View.

  2. In the Identify by Properties pane, go to Technical properties.

  3. For the Label property, change the label of a control to match the actual label.

Label property in XScan

  1. Save your Module and close the XScan window.

In this example, you change the Label property to Annual Mileage [mi] to reflect the control label in the user interface.

Label property in XScan

Change the parameters for table detection and steering

Apart from standard table steering parameters for TBox tables, Vision AI provides additional table steering parameters that enable you to detect and steer tables more efficiently.

To adjust table parameters, follow the steps below:

  1. In XScan, select your Table control and switch to the Advanced View.

  2. Click Show Content Preview, to open the Content View pane.

    In the Content View pane, you can see how changes in table steering parameters affect the table.

  3. In the Identify by Properties pane, you can modify the following additional parameters:

  4. Save your Module and close the XScan window.

What's next

Once you have scanned your controls, you can use them in your TestCases.