Test Plan Executions
Test Executions refer to the process of running test cases to verify whether the mobile application behaves as expected under specific conditions. This is a crucial phase in the testing lifecycle, where predefined scripts or steps are executed, and their outcomes are recorded.
For the Execution to begin, Test Plan creation is a crucial step. A test plan can be a source of Test Suite, Test Rule, Test Case, or Deeplink. When a test plan is executed, the test suites and their corresponding test cases are executed serially or parallelly as configured. The main purpose of the Test plan is to facilitate the automation of Test cases with the relevant test data/values. An executable setup is created, which will be the final step of automating the testing process.
This article guides the user in preparing and executing test plans on the QApilot platform. For demonstrative purposes, we will discuss the execution of a test plan that has one test suite and one test case associated with the test suite:
Prerequisites
You should know how to Create a Test Case, Test Suite, Test Rule, and Deeplink.
Listing Test Plans
On the Test Plans List page, you will have the below options:
Navigate to Test Plans in the left-side navbar.
You can easily manage test plans on the Test Plans list page by filtering, or searching. The page displays test suites with titles, types, creation dates, creators, and statuses.
Click Create Test Plan.
Steps to Create and Execute Test Plan
Navigate to Test Plan in the left-side navbar. Click the Add Test Plan. Provide the below details to Create a Test Plan:
It redirects to the Test Execution Screen:
The User is redirected to the execution screen. The Execution process takes three steps.
Enter the Title of the Execution in the respective text box as shown below.
Select the Operating System.
Select the Source From Test Rule, Test Suite, Test Case, or Deeplink.
click on the Next
Select the Virtual Device for execution in the second step.
Select the respective Device from the dropdown. QApilot allows multiple devices to perform running tests concurrently across various devices to ensure an application functions correctly.
Select Test Data from the drop-down.
Select the App Source from the dropdown. Select the Next button.
The third step includes Execution Settings which need to be applied, otherwise, default settings can be retained as per the Business Requirements.
Execution Settings are configurations to apply for the execution:
Enable Screenshot: Enable Screenshots allow the capture of images during test execution, which is essential for debugging, validation, and reporting purposes.
Step Image Screenshot: Step Image Screenshot captures a visual snapshot of the application state at specific test steps.
Auto close Contextual popup: This refers to the automatic dismissal of pop-up windows, tooltips, or contextual menus after a specific user action, delay, or event.
Enable Geo Location: This allows applications to access or simulate the user’s physical location.
Wait Time Between Steps: Wait Time Between Steps is the deliberate pause added between consecutive actions in a test script to ensure that each step completes properly before the next begins.
Command Time Out: Command Timeout is the maximum duration that an automation command is allowed to run before it is forcefully terminated.
Max Concurrent Errors: Max Concurrent Errors refers to the maximum number of errors or failures that are allowed to occur simultaneously within a single test execution or session.
Advance options: These configurable settings allow testers to fine-tune the behavior and performance of test executions.
Enable Video: Enable Video allows for recording a video of the entire test execution session. This feature captures each step, action, and interaction within the application as the test progresses, creating a valuable visual record.
Enable CPU: Enable CPU is a feature that allows testers to monitor the CPU usage of a device or application during test execution.
Enable Memory: Enable Memory allows testers to monitor the memory usage of a device or application during the execution of tests.
Enable Network Trace: Enable Network Trace allows testers to capture and analyze the network traffic generated by an application during testing.
VPN Required: VPN Required typically refers to the necessity of using a Virtual Private Network (VPN) to securely connect to specific resources, environments, or networks that are not accessible over the public internet.
CI/CD Configurations: By enabling CI/CD configurations, you can ensure that your code is continuously validated through automated tests. Refer to Continuous Integration/Continuous Deployment
For Cloud Device Execution, CD/CD Configuration is applicable.
After applying the Execution Settings, click on the save button to Execute.
The below Confirmation window will display. Click on the Yes button.
The Test Suite is executed as per the specified criteria.
As you can see below, Execution is running. Total Cases are displayed along with the Notifications.
Once the executions are completed, these are acknowledged in the form of Reports.
Click the eye/view icon under the Actions columns to View the report's details.
The user is redirected to the detailed view of the executed Suite.
The report has a set of tabs displaying different aspects of the executed process.
The Summary tab provides the overall view as shown above.
The Testcase tab displays details of every step and the respective timings and status.
The Artifacts tab shows the screenshots.
The Test Data tab displays the Test values used for the execution process.
Others tab displays the settings of the execution process which includes the includes of Flags and Debug Logs.
The New Test Plan is created and it will be in the Active State displays on the Test Plan Listing Page.
It allows you to perform various actions on the Test Plan which are: Edit, Schedule Run, Enable CI/CD, Disable, Delete
If you delete the Test Plan, you will lose all Run reports and Run configurations associated with it.
Last updated