XRay Test Runs levels in Jira Snapshots
If you use XRay Test Management for Jira you can use Jira Snapshots to create test reports.
Many details of Test Runs can be included in their own type of level: a Test Run level.
With a Test Run level:
You can include the data related to the test runs of the test. For test issues in a certain level, if the next level is a Test Runlevel, then the test run data of that test will be included in the test run level.
You can filter which test runs are included in the level. The inclusion is a combination of these criteria:
All, or only the latest test run
Test runs associated with specific versions
Test runs associated with specific test environments
You can include many fields which are specific to test runs.
How to configure a “Test Run level”
A test run level is always the last level, but it cannot be the 1st level.
Once a test run level is set, a subsequent level cannot be added.
Start by creating a level to retrieve the Xray test issues you need.
Once the test level is configured, add a new level
To configure the new level as a Test Runs level:
Set the level type to be “Test Runs”
Use the available criteria to filter which test runs will be included
Set the fields to display
The available criteria to filter test runs
Criteria | Effect | |
|---|---|---|
| 1 | Search JQL | The JQL will be applied on the test execution’ issue that the test run belongs to. For example, “Status=Done” will have the impact that only test runs belonging to test executions that are in status Done will be included. |
| 2 | Select Test Runs: All/Latest |
|
| 3 | Test Runs Statuses | Test Runs need to be in one of the specified statuses. If empty, all statuses are retrieved. This is a good criterion to use if you want to exclude, for example, FAILED runs. |
| 4 | Fix versions | Only test runs associated with any of the versions specified will be considered. If empty, this criterion is ignored. Note: the ‘versions' field on the test run is inheriting its value from the 'Fix versions' field of the test execution. |
| 5 | Test environments | Only test runs associated with any of the Test environments specified will be considered. If empty, this criterion is ignored. |
Fields available for test runs
Select from the list of fields:
Link to test run
Test key
Test execution key
Test Execution Status
Test Execution Summary
Test environments
Fix versions - this is the ‘versions’ field in the Xray interface (we use the Jira naming here)
Status
Revision
Assignee
Executed by
Defect - optionally, this field will also display the Defect status. See configuration option under the tab ‘Test Runs Level Layout’ (and screen capture below)
Eidences
Started on
Finished on
Comment
Gherkin
Definition
Test version - applicable for Xray Enterprise