Configuring Application Testing

Overview

Application Tests verify that your user software functions correctly and remains within established operational parameters. Similar to Load Tests, these are one-time, on-demand tests that return data and events specific to the current test. They are not scheduled to run periodically.

How It Works

An Application Test launches a single session. It only requires one session because it does not gather long-term tracking data, unlike Continuous Tests, and it does not measure aggregate performance, unlike load tests. Its sole purpose is to select a single virtual desktop infrastructure (VDI) and run a set of Application scripts to verify that your software is functional. EUX testing cannot be enabled for these tests.

Application scripts for Application Tests focus on functional areas rather than metrics. While a Continuous Test might benefit from timing every operation with measurable durations, an Application Test aims to verify that each part of the program functions correctly. The scripts should check various aspects of the program, aborting if any errors occur. If timers are used, they are intended to identify significant issues, such as tasks that never complete, rather than small speed changes.

Unlike Load Tests, Application Tests can trigger alert emails for threshold violations.

Note: EUX and VSImax, designed as aggregate statistical measures, are unavailable in Application Tests. However, as Application Tests utilize only one session, the Desktop Connector remains accessible. For more information, see Desktop Connector.

Creating an Application Test

  1. In the Login Enterprise sidebar menu, navigate to Configuration > Manage Tests, and select Application Tests.

Frame 1891.png
  1. In Application Tests, click “+“ on the top right to create a test.

Frame 1892.png
  1. Define the connection settings:

Field

Description

Name

The display name for the Application Test.

Description (optional)

An informative description of the Application Test.

Connector

The type of Connector to be utilized by the Launcher.

Note: Each Connector has its own settings. Once you define your Connector, you need to specify the necessary information in the Settings section. For details, see Connectors.

Access

Select roles to control access to Test configurations and results. For more information, see Role-Based Access Control (RBAC).

  1. Click Save to apply the changes.

Frame 1893.png

Configuring Application Test Settings

Once you’ve created an Application Test, you need to configure the Test settings, such as:

Setting

Description

Verbose logging

Display the command line number that triggered an error during Application execution failures.

Note: This may affect test results as the line number is returned during execution.

Logon time tracking process

  • Track the complete duration from when the Connector initiates the login process for the user session until the final user-session executable (usually Windows Explorer) is up and running.

  • You can also overwrite the default process of time tracking with a process of your choice. For details, see Measuring Total Login Time.

Frame 1894.png

Report Settings

You can configure the Test Report settings, such as:

Setting

Description

Include successful applications

  • Choose to capture a screenshot of successful applications when the script starts the program without errors.

  • Disabling this option skips the screenshot, but the results of the successful applications (such as measurements) will still be included in the report. 

  • This option only produces screenshots if your script uses the built-in START() command to start your program. Otherwise, you can use the TakeScreenshot() command in your script after you start the program.

Email notification

  • Choose to be notified when Applications pass or fail.

  • If you do not enable notifications, the report will only indicate failures, which is usually the most relevant information.

You can also configure the system to send an email once the Application Test is complete. If the email notification switch is enabled but no email address is specified, the default email address from the email configuration will be used. You can enter multiple email addresses in the Email Notification field, separated by commas. For more information, see Managing Notifications.

Tip: You can personalize the report by adding your company logo.

Note: There is no strict limit on the number of screenshots in a generated PDF report. However, note that including a large number of screenshots (for example, up to 1,000 screenshots) may cause browser downtime and increase the PDF file size.

For optimal performance and compatibility, we recommend keeping the number of screenshots below 250. At around 250 screenshots, the PDF size is typically under 20 MB, which aligns with email systems that limit attachments to 20 MB.

Frame 1895.png

Actions

You can add the preferred Applications for the Virtual User to test. You can also add Application Groups, and “Waits.” For details, see Configuring Applications for Testing.

Thresholds

You can also define thresholds for all Actions. These thresholds ensure that the Application not only functions correctly but also maintains its performance across different configurations. If performance thresholds are not met, you will be notified in the Application Testing report.

Frame 1896.png

Access

You can assign roles to Tests to control access to the Test configuration and results. By assigning roles, only users with the designated roles will be able to view or modify the Test configuration and results, depending on their permissions. For detailed instructions on creating and managing roles, permissions, and dependencies, see the Role-Based Access Control (RBAC).

Frame 1897.png

Adjusting the Engine Start Timeout

This setting works in the same way for all Test types. For details, see Adjusting the Engine start timeout.

Starting an Application Test

  1. In the Application Tests, click the Play button next to the test you’d like to start.

Frame 1898.png

Note: Even if you configured a user group that contains multiple users, the Application Test scenario only uses one user. 

  1. After you click Play, a confirmation dialog window will appear, displaying the current Application configuration. If the configuration is correct, click Confirm to begin the test.

Frame 1899.png
  1. Once you click Confirm, you will be redirected to the Test Dashboard. Here, you can view the current status of your recently started Application Test. The dashboard displays how many Applications have started and if any have failed. Performance measurements are also shown. For more information, see the Test Dashboard.

Starting the Application Test from Test Config

You can run an Application Test directly from the Test configuration page. This allows you to run the Test immediately after reviewing or editing its settings, without returning to the Overview page.

Unlike Load Tests, multiple Application Tests can run at the same time. The Run Test button remains available even if other Application Tests are currently running. If there are unsaved changes, clicking Run Test will trigger a confirmation pop-up:

Frame 1900.png

Tip: Click Save and Run to save your changes and start the Test. Click Cancel to return to the page without starting the Test or saving your changes.

For Desktop Connector Tests, clicking Run Test opens the same pop-up used on the Overview page.

Best Practices: Handling Partial Failures in Scripts

Script failures are treated as an all-or-nothing outcome. If any function fails, the entire script is marked as failed. This can make it difficult to evaluate multiple functions within a single test.

If you need more granular results and want the script to continue running even after a subtask fails, consider the following approaches.

Log Subtask Failures with Events

Use CreateEvent in your script to log when a specific subtask fails.

This allows the script to:

  • Record the failure in the Login Enterprise events for the Test Run.

  • Continue executing the remaining subtasks.

This approach is useful when you want to capture multiple issues in a single Test Run instead of stopping at the first failure.

Use Timers to Represent Functional Results

Timers can also be used to report success or failure conditions.

Instead of measuring a duration with StartTimer and StopTimer, use SetTimer to report a predefined value.

Example approach:

  • Success value: 1000 (represents 1 second)

  • Failure value: 2000

Configure an alert threshold (for example, 1500) so that:

  • Values below the threshold indicate success

  • Values above the threshold indicate failure

Using clearly distinguishable values (such as 1000 and 2000) makes the script easier to read and maintain compared to smaller values like 1 and 2.

Application Test Results

For information on the Application Test results, see Viewing Application Testing Results.