Create User Identified Controls

You can teach Vision AI to work with controls that are not recognized correctly, for example if a table is not recognized as a table. To do so, use the feature User Identified Controls (UIDCs). This feature enables Vision AI to recognize a control correctly using surrounding controls as anchor points. Vision AI uses these anchors as reference points to identify the control.

Create a new User Identified Control

To create a new UIDC, follow the steps below:

  1. Open XScan via Modules->Scan->Application and select Vision AI in the Select Application window (see chapter "Scan controls with Tricentis Vision AI").

  2. Ensure that XScan is in the Advanced View.

  3. In XScan, right-click the main item and select Create User Identified Control... from the context menu.

Context menu in XScan

  1. Vision AI opens the Vision AI assistant window and the preview of your application.

  2. Draw a box around the control that you want to identify.

  3. In the preview of your application, click on the controls that you want to use as anchors. Anchors teach Vision AI to recognize a UIDC correctly. You can select anchors that are inside and outside of the UIDC. These controls appear in the Vision AI assistant window in the Anchor points section.

    If you select only one control as an anchor, Vision AI always returns the UIDC with the same size and position in relation to the anchor control. In case the anchor control in the application under test is bigger or smaller, the UIDC might not be recognized correctly. Tricentis recommends using text labels as anchors, that appear only once on the screen. For variable sized controls, use more than one anchor at each side or corner of the control. Specifying anchors on the left and right will allow the control to expand horizontally, and anchors on the top and bottom will allow the control to expand vertically. Selecting anchors inside the control is also allowed, e.g. selecting the left and right column headers of a table.

New User Identified Control in the Vision AI assistant window

  1. Edit the following information about the new control:

    • For Control Name, enter the name of your control. The name of your control should be unique for each application that you define in the Application field.

    • For Control Type, select the type of your control from the drop-down list.

    • For Application, select the application from the drop-down list. In this field, you can also enter a new name for the application. In XScan, you use the application name for the steering parameter UidcCategory.

  1. Click Save.

    In the subsequent dialog box, select Yes to rescan your application.

  2. Click Select on screen to select the control in your application once again. This control is now recognized correctly based on the parameters that you specified in the Vision AI assistant window.

    Alternatively, you can select the control directly in the XScan window. The name of this control corresponds to the name that you specified in the Control Name input box.

The information about your UIDCs is stored on your company's Nexus container and shared between all users in your company.

To see all UIDCs created in your company, go to https://vision-ai.app.tricentis.com/ and click on Open Configuration and select Controls from the left navigation pane. Here you can also delete or reactivate your UIDCs.

Use the steering parameter UidcCategory

The application name lets you categorize your UIDCs into groups of controls that Vision AI uses for the specified applications. To use a category that you defined with the application name, you must edit the steering parameter UidcCategory.

To do so, open the Identify by Properties pane in XScan and in the UidcCategory, enter the application name that you defined in the Vision AI assistant.

In this example, you create two categories of UIDCs:

  • UIDCs for an SAP application. In the Vision AI assistant, you enter SAP into the Application field for each UIDC.

  • UIDCs For a Salesforce application. In the Vision AI assistant, you enter Salesforce into the Application field for each UIDC.

Application name in the Vision AI assistant

In XScan, you scan other controls in an SAP application and you want to use the UIDCs that you defined only for an SAP application. To do so, you enter SAP into the steering parameter UidcCategory. Vision AI doesn't display any UIDCs that you defined for your Salesforce application.

UidcCategory steering parameter

Delete or reactivate your UIDCs

You can delete or reactivate your UIDCs on the Vision AI Home website.

To delete a UIDC, follow the steps below:

  1. Go to https://vision-ai.app.tricentis.com/.

  2. Click on Open Configuration.

  3. Sign in to your account.

  4. In the menu on the left, click on Controls.

  5. In the Users' identified controls, click the Delete icon next to the control that you want to delete.

    The control is not deleted permanently, but moved to the Deleted items section where you can reactivate it. It is not possible to delete an UIDC permanently.

Users' identified controls section

To reactivate a UIDC, follow the steps below:

  1. Go to https://vision-ai.app.tricentis.com/.

  2. Click on Open Configuration.

  3. Sign in to your account.

  4. In the menu on the left, click on Controls.

  5. In the Deleted items, click the Reactivate icon next to the control that you want to reactivate.

Deleted items section

Video - Create a User Identified Control (UIDC)

In this session, we will show you how to create a new UIDC with Vision AI.

This video was created with Tosca version 14.0