Test Audit App

The Test Audit App is provided with a set of Most-at-risk objects obtained from the Smart Impact App, and performs an audit of the objects, retrieving usage data for them from the QA and Performance History systems. Optionally, the Most-at-risk tokens are used to retrieve matching tests from the specified ALM Test Repository, and the App reports the run status of each matching test instance.

A user with LiveCompare Editor privileges must prepare this App by making sure that performance history data is available for the ‘Performance History System’ RFC Destination. See the ‘Prerequisites’ section below for details.

DevOps Categories

Testing

Prerequisites

Before running the Test Audit App for the first time, you will need to make sure that performance history data is available on the RFC Destination selected for the ‘Performance History System’. Select the RFC Destination in the LiveCompare hierarchy and click the PHD tab. Select the source for performance history data, and if necessary the number of months of data to retrieve, then click ‘Update Data’. The performance history data may also be retrieved using a schedule. See the Retrieving Performance History Data help topic for details.

Running the App

To run the Test Audit App, select the App from the Home screen and create an App variant. Complete the variant screen as follows:

  • Set the ‘Start Date’ control to the start date for which usage data is to be retrieved from the QA system.
  • Set the ‘End Date’ control to the start date for which usage data is to be retrieved from the QA system.
  • Set the ‘QA System’ field to the RFC Destination for your QA system.
  • Set the ‘Performance History System’ field to the RFC Destination for the Performance History system used when running the Impact App.
  • Edit the ‘Tokens’ table to provide a list of Most-at-risk tokens. The tokens may be obtained from the Impacted Objects Excel spreadsheet generated by the Smart Impact App.
  • Set the ‘Search test labs?’ switch to specify whether the ALM Test Repository’s test labs will be searched for matching tests.
  • If required, set the ‘Test Repository’ field to the ALM Test Repository to be searched for matching tests. Choose --Not Selected-- if required to clear your selection.
  • Edit the ‘Test Search Paths’ string list to provide a list of test lab paths to be searched, for example, ‘Root\Test Set Folder’ or ‘Root\Test Set Folder\Phase1’. Each path and all its descendants are searched. If this parameter is not set, all test lab paths will be searched.

Click ‘Run’. When the variant has completed, its results may be accessed from the App Cockpit screen.

App Results

The Test Audit App generates a Dashboard report which includes the following charts:

  • The Test Audit summary pie chart summarizes the Most-at-risk objects, indicating whether they have been run on the QA system according to the retrieved performance history data.
  • The Test Lab Summary pie chart summarizes the test instances in the specified Test Repository according to their run status. This chart is displayed if the App’s ‘Search test labs?’ switch is set to ‘Yes’.

Dashboard tiles indicate the name of the QA system, the range of dates for which performance history data was found, whether test labs were searched, and the name of the specified Test Repository.

The Dashboard report also includes links to the following reports:

Test Audit Excel Report

This report includes the following spreadsheets:

Dashboard

This spreadsheet displays the charts shown in the Dashboard report.

Help

This spreadsheet provides descriptions for the columns in the Test Audit Details and Test Lab Details spreadsheets.

Test Audit Details

This spreadsheet displays usage data for the Most-at-risk objects, obtained from the QA and Performance History System. The BUSINESS_CRITICAL column is populated using the Business Critical Objects External Data Source.

Test Lab Details

This spreadsheet displays the ID, path and run status for tests stored in test labs in the specified Test Repository. The spreadsheet is populated if the App’s ‘Search test labs?’ switch is set to ‘Yes’.

Analysis Input Data

This Excel report contains a copy of the input parameters used to produce the App’s Dashboard report. The value of each input parameter is stored in a separate worksheet, which is named after the parameter whose value it contains.

Standard Apps