Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

impr(ci): try outputting junit report #4828

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

armcknight
Copy link
Member

@armcknight armcknight commented Feb 11, 2025

If we want to stick with xcbeautify, we need to find a way to make the test results more readable. This uses the -reports junit option, and then tries out a few different github marketplace actions that consume a JUnit XML file and prepare reports, add annotations to the PR diff, etc for a failing test.

TODO

  • get the UI tests generating JUnit XML files as well, unsure if Fastlane's xcbeautify integration supports this, just try it out and see

#skip-changelog

Copy link

codecov bot commented Feb 11, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 9.165%. Comparing base (18bf9a5) to head (3c45620).

❗ There is a different number of reports uploaded between BASE (18bf9a5) and HEAD (3c45620). Click for more details.

HEAD has 3 uploads less than BASE
Flag BASE (18bf9a5) HEAD (3c45620)
4 1
Additional details and impacted files

Impacted file tree graph

@@              Coverage Diff              @@
##              main    #4828        +/-   ##
=============================================
- Coverage   91.519%   9.165%   -82.355%     
=============================================
  Files          655      347       -308     
  Lines        76553    24756     -51797     
  Branches     27683       94     -27589     
=============================================
- Hits         70061     2269     -67792     
- Misses        6393    22487     +16094     
+ Partials        99        0        -99     

see 646 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 18bf9a5...3c45620. Read the comment docs.

@@ -209,6 +209,26 @@ jobs:
--device "${{matrix.device}}" \
--configuration TestCI \
--scheme ${{matrix.scheme}}

- name: Publish Test Report
uses: mikepenz/action-junit-report@v5

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 🚫 Please pin the action by specifying a commit SHA instead of a tag/branch.

report_paths: 'build/reports/junit.xml'

- name: Test Report
uses: dorny/test-reporter@v1

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 🚫 Please pin the action by specifying a commit SHA instead of a tag/branch.

reporter: swift-xunit

- name: Test Summary
uses: test-summary/action@v2

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 🚫 Please pin the action by specifying a commit SHA instead of a tag/branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant