Reports Comparision
Report comparison is a critical process that helps teams assess the outcomes of test executions over different builds, environments, or versions of an application. This process not only ensures consistency and accuracy in test results but also aids in identifying regressions, validating fixes, and providing insights into overall application quality.
Prerequisites
Ensure that you have executed one test plan on multiple devices.
Test Plan and Device Name must match to ensure a valid comparison.
How To Compare Reports?
Go to the reports listing and choose 2 reports with the same Device and Test Plan to compare.
Test Plan and Device Name should be the same for the base report and target report.
It redirects to the below window. Give a title for selected compare reports.
Click on the Create button and it redirects to the below window:
The selected reports comparison has been created. Click on Yes to check the status and view of the comparisons.
Click on View detail:
When generating and comparing reports, a well-structured workflow is essential for ensuring that the process is efficient and the results are meaningful. As shown above is a detailed workflow that outlines the steps involved in report generation, artifact comparison, and analysis of results, including the use of percentage matching and color coding to represent outcomes.
Last updated