Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Requesting for a feature to add playwright test.steps related execution results and attachments to Xray-App/playwright-junit-reporter #8

Open
LahiruMadhawa2020 opened this issue May 25, 2024 · 1 comment

Comments

@LahiruMadhawa2020
Copy link

🚀 Feature Request
Requesting for a feature to add playwright test.steps related execution results and attachments to Xray-App/playwright-junit-reporter (https://github.com/Xray-App/playwright-junit-reporter).

While importing test execution results, whole test was represented by one line in XRAY. However, with a recent feature update in XRAY, it is showing all the steps & the execution result is only getting imported for the global test case. Test steps neither have any statuses marked nor evidences attached. It is understood that junit reporter is not supporting the requested feature. However, would like to know the feasibility from your team to implement the requested feature with Xray-App/playwright-junit-reporter.

Example
This feature will be able to update the test steps wise results where the current implementation only provides support to import overall test execution results & evidences globally.

Motivation
Since other tools doesn't have test.step feature to have a 1:1 mapping with the test steps from the test management tool, if this feature is available playwright will be the only tool with the feature (except for Micro Focus UFT & QTP commercial tools) & the value of having test.steps will return a considerable ROI. Since playwright integration with XRAY depends on the Xray-App/playwright-junit-reporter, it will be an achievement for the Xray-App/playwright-junit-reporter team as well.

@bitcoder
Copy link
Contributor

bitcoder commented Jun 3, 2024

Hi @LahiruMadhawa2020 , the idea makes and would be useful. However, the implementation would be hard. First, the current JUnit enhanced XML format doesn't have a way to embed/process step-level information. To support that, it would require enhancing the Xray product itself (you can reach our Xray support team asking for such an improvement).

The other option would be to use a Xray JSON report instead. In that case, it would require building a new reporter from scratch.. also, the Tests on Xray side would need to be abstracted as "Manual" tests as the current "Generic" tests don't have a "step" kinda of notion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants