Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] Publish test results #23477

Closed
wants to merge 5 commits into from
Closed

[ci] Publish test results #23477

wants to merge 5 commits into from

Conversation

dg0yt
Copy link
Contributor

@dg0yt dg0yt commented Mar 10, 2022

  • What does your PR fix?

    Publish CI results as AZP test results.

  • Which triplets are supported/not supported? Have you updated the CI baseline?

    --

  • Does your PR follow the maintainer guide?

    --

  • If you have added/updated a port: Have you run ./vcpkg x-add-version --all and committed the result?

    --

@dg0yt
Copy link
Contributor Author

dg0yt commented Mar 10, 2022

Findings:
(https://dev.azure.com/vcpkg/public/_build/results?buildId=68588&view=ms.vss-test-web.build-test-results-tab)

  • While not building a single port for x64-osx (due to caching), the results contain 1910 tests (1617 "passed", 0 "failed", 293 "not executed", 0 "other").

  • Intial uploading x64-osx results for 1910 tests took 3 m 37 s, but for the other triplets it was < 10 s.

  • The original xUnit result file can be downloaded, for more details.

  • Summary for AZP on this PR's Checks tab in GH:

    Failed: 0 (0.00%)
    Passed: 13,146 (76.15%)
    Other: 4,118 (23.85%)
    Total: 17,264

test

test2

@JonLiu1993 JonLiu1993 assigned JackBoosY and unassigned JackBoosY and JonLiu1993 Mar 10, 2022
@dg0yt
Copy link
Contributor Author

dg0yt commented Mar 10, 2022

Possible changes for vcpkg-tool xUnit output
(Implemented refers to scripts/process-test-results.ps1):

  • There should be some filtering and mapping of results to give useful analytics.
    "Outcome" must be reported in /assemblies/assembly/collection/test/failure.Attributes["result"].Value.
    Vcpkg reports a result attribtue (Pass/Skip/Fail), and it adds a reason element for skipped tests. This reason is not processed by AZP. It cannot be put into a failure element: The presence of a "failure" element is interpreted as a failed test.
    Implemented: Test results are omitted for unaffected ports (unchanged ABI hash).

    vcpkg ci result AZP test analytics
    SUCCEEDED passed
    BUILD_FAILED failed
    POST_BUILD_CHECKS_FAILED failed
    FILE_CONFLICTS failed
    CASCADED_DUE_TO_MISSING_DEPENDENCIES not executed
    EXCLUDED not executed
    CACHE_MISSING ---
    DOWNLOADED ---
  • The "Test run" is taken from an AZP task property, not from the data. Thus for non-native triplets, this is insufficient to group results by triplet.
    Implemented: The actual triplet is stored in the "owner" field.

  • "Test result" "Title" might be the full string of port, features, triplet, version (xUnit: /assemblies/assembly/collection/test.Attributes["method"].Value).
    Implemented: port[features]:triplet

  • For "Test file", I would prefer the port name without triplet (xUnit: /assemblies/assembly.Attributes["name"].Value).
    Implemented: port

  • It might be possible to include stdout as "Console log" (xUnit: /assemblies/assembly/collection/test/failure/output).

  • It might be possible to append other logs as "Attachements".
    Not support by the AZP task.

  • It might be possible to put useful information in the "Stack trace".

References:
https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/test/publish-test-results?view=azure-devops&tabs=xunit2%2Cyaml
https://xunit.net/docs/format-xml-v2

@dg0yt
Copy link
Contributor Author

dg0yt commented Mar 10, 2022

There is now also aggregated data for the "pipeline":
https://dev.azure.com/vcpkg/public/_test/analytics?definitionId=27&contextType=build

@JackBoosY JackBoosY added the category:infrastructure Pertaining to the CI/Testing infrastrucutre label Mar 11, 2022
@JackBoosY JackBoosY requested a review from BillyONeal March 11, 2022 02:19
@JackBoosY
Copy link
Contributor

cc @BillyONeal

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

You have modified or added at least one vcpkg.json where a "license" field is missing.

If you feel able to do so, please consider adding a "license" field to the following files:

  • scripts/test_ports/cmake-user/vcpkg.json

Valid values for the license field can be found in the documentation

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

You have modified or added at least one vcpkg.json where a "license" field is missing.

If you feel able to do so, please consider adding a "license" field to the following files:

  • scripts/test_ports/cmake-user/vcpkg.json

Valid values for the license field can be found in the documentation

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: d9b335de3825f7538c76162745c1e0bf3010e783
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

You have modified or added at least one vcpkg.json where a "license" field is missing.

If you feel able to do so, please consider adding a "license" field to the following files:

  • scripts/test_ports/cmake-user/vcpkg.json

Valid values for the license field can be found in the documentation

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

Error: Local changes detected for librttopo but no changes to version or port version.
-- Version: 1.1.0#5
-- Old SHA: d747c88d429ff781b11627623d0958967f912a41
-- New SHA: 5819abd14ead64303849e59b258dc8c492125610
-- Did you remember to update the version or port version?
-- Pass `--overwrite-version` to bypass this check.
***No files were updated.***

You have modified or added at least one vcpkg.json where a "license" field is missing.

If you feel able to do so, please consider adding a "license" field to the following files:

  • scripts/test_ports/cmake-user/vcpkg.json

Valid values for the license field can be found in the documentation

@dg0yt
Copy link
Contributor Author

dg0yt commented Mar 12, 2022

I think this is good enough for merge now.
Using parent hashes, all test results for unaffected ports are removed. This gives a more representative result with regard to the impact of a PR. Unrelated baseline regressions will still show up via tests for affected ports with result type "other"/"not executed", reducing the "Pass percentage".

Unbenannt

I couldn't find out why the features aren't displayed reliably. Maybe this it is just a side effect of the work being in progress in this PR.

CC @BillyONeal

@dg0yt dg0yt marked this pull request as ready for review March 12, 2022 08:46
@BillyONeal
Copy link
Member

Are you happy with saying microsoft/vcpkg-tool#437 implements all the powershell stuff here and that only the stuff to get AzureDevOps to upload the bits should be kept here? (I understand not wanting to touch this until that lands in an actual tool release, I just want to make sure we're on the same page though)

@dg0yt
Copy link
Contributor Author

dg0yt commented Apr 1, 2022

I'm happy when the tool does the main work soon, and this PR can wait. However, it will make it harder to experiment with any further improvements. That's why I wonder if it shouldn't be merged as a script first.
And I am curious if CI regressions might be more visible from the pipeline's Unique failing tests table... Sometimes I'm not happy with the level of awareness for current CI health.

@BillyONeal
Copy link
Member

However, it will make it harder to experiment with any further improvements. That's why I wonder if it shouldn't be merged as a script first.

Our experience is that such scripts become impenetrable messes and we've really been trying to make sure anything new that we do is done in the tool proper. Yes, that means we need a better end to end test experience to try out tool changes, and I'm on the hook to do that, and will be doing it after this Patch Tuesday where I get enough bits to build ourselves installed-by-default in the build lab.

BillyONeal added a commit to microsoft/vcpkg-tool that referenced this pull request Apr 6, 2022
…ss. (#437)

* Reduce build output chattiness.

This change deletes the word "package" from several places where it is clear, and deduplicates "starting install" and "installing" messages.

Before:

```
PS C:\Dev\vcpkg> .\vcpkg.exe install zlib
Computing installation plan...
The following packages will be built and installed:
    zlib[core]:x86-windows -> 1.2.11#13
Detecting compiler hash for triplet x86-windows...
Restored 1 packages from C:\Users\bion\AppData\Local\vcpkg\archives in 43.57 ms. Use --debug to see more details.
Starting package 1/1: zlib:x86-windows
Installing package zlib[core]:x86-windows...
Elapsed time for package zlib:x86-windows: 18.41 ms

Total elapsed time: 2.266 s

The package zlib is compatible with built-in CMake targets:

    find_package(ZLIB REQUIRED)
    target_link_libraries(main PRIVATE ZLIB::ZLIB)

PS C:\Dev\vcpkg> .\vcpkg.exe remove zlib
The following packages will be removed:
    zlib:x86-windows
Removing package zlib:x86-windows...
PS C:\Dev\vcpkg> .\vcpkg.exe install zlib --no-binarycaching
Computing installation plan...
The following packages will be built and installed:
    zlib[core]:x86-windows -> 1.2.11#13
Detecting compiler hash for triplet x86-windows...
Starting package 1/1: zlib:x86-windows
Building package zlib[core]:x86-windows...
-- Using cached zlib1211.tar.gz.
-- Extracting source C:/Dev/vcpkg-downloads/zlib1211.tar.gz
-- Applying patch cmake_dont_build_more_than_needed.patch
-- Applying patch 0001-Prevent-invalid-inclusions-when-HAVE_-is-set-to-0.patch
-- Applying patch add_debug_postfix_on_mingw.patch
-- Applying patch 0002-android-build-mingw.patch
-- Using source at C:/Dev/vcpkg/buildtrees/zlib/src/1.2.11-e9a093319e.clean
-- Configuring x86-windows
-- Building x86-windows-dbg
-- Building x86-windows-rel
-- Installing: C:/Dev/vcpkg/packages/zlib_x86-windows/share/zlib/vcpkg-cmake-wrapper.cmake
-- Fixing pkgconfig file: C:/Dev/vcpkg/packages/zlib_x86-windows/lib/pkgconfig/zlib.pc
-- Using cached msys-mingw-w64-i686-pkg-config-0.29.2-3-any.pkg.tar.zst.
-- Using cached msys-mingw-w64-i686-libwinpthread-git-9.0.0.6373.5be8fcd83-1-any.pkg.tar.zst.
-- Using msys root at C:/Dev/vcpkg-downloads/tools/msys2/9a1ec3f33446b195
-- Fixing pkgconfig file: C:/Dev/vcpkg/packages/zlib_x86-windows/debug/lib/pkgconfig/zlib.pc
-- Installing: C:/Dev/vcpkg/packages/zlib_x86-windows/share/zlib/copyright
-- Performing post-build validation
-- Performing post-build validation done
Installing package zlib[core]:x86-windows...
Elapsed time for package zlib:x86-windows: 4.83 s

Total elapsed time: 7.009 s

The package zlib is compatible with built-in CMake targets:

    find_package(ZLIB REQUIRED)
    target_link_libraries(main PRIVATE ZLIB::ZLIB)

PS C:\Dev\vcpkg> .\vcpkg.exe x-set-installed
The following packages will be removed:
    zlib:x86-windows
Starting package 1/1: zlib:x86-windows
Removing package zlib:x86-windows...
Elapsed time for package zlib:x86-windows: 9.93 ms
Restored 0 packages from C:\Users\bion\AppData\Local\vcpkg\archives in 92.5 us. Use --debug to see more details.

Total elapsed time: 14.01 ms

PS C:\Dev\vcpkg> .\vcpkg.exe remove zlib
The following packages are not installed, so not removed:
    zlib:x86-windows
Package zlib:x86-windows is not installed
PS C:\Dev\vcpkg>
```

After:

```
PS C:\Dev\vcpkg> ..\vcpkg-tool\out\build\x64-Debug\vcpkg.exe install zlib
Computing installation plan...
The following packages will be built and installed:
    zlib[core]:x86-windows -> 1.2.11#13
Detecting compiler hash for triplet x86-windows...
Restored 1 packages from C:\Users\bion\AppData\Local\vcpkg\archives in 60.79 ms. Use --debug to see more details.
Installing zlib:x86-windows (1/1)...
Elapsed time for zlib:x86-windows: 20.03 ms

Total elapsed time: 2.662 s

The package zlib is compatible with built-in CMake targets:

    find_package(ZLIB REQUIRED)
    target_link_libraries(main PRIVATE ZLIB::ZLIB)

PS C:\Dev\vcpkg> ..\vcpkg-tool\out\build\x64-Debug\vcpkg.exe remove zlib
The following packages will be removed:
    zlib:x86-windows
Removing zlib:x86-windows (1/1)...
PS C:\Dev\vcpkg> ..\vcpkg-tool\out\build\x64-Debug\vcpkg.exe install zlib --no-binarycaching
Computing installation plan...
The following packages will be built and installed:
    zlib[core]:x86-windows -> 1.2.11#13
Detecting compiler hash for triplet x86-windows...
Installing zlib:x86-windows (1/1)...
Building zlib[core]:x86-windows...
-- Using cached zlib1211.tar.gz.
-- Cleaning sources at C:/Dev/vcpkg/buildtrees/zlib/src/1.2.11-e9a093319e.clean. Use --editable to skip cleaning for the packages you specify.
-- Extracting source C:/Dev/vcpkg-downloads/zlib1211.tar.gz
-- Applying patch cmake_dont_build_more_than_needed.patch
-- Applying patch 0001-Prevent-invalid-inclusions-when-HAVE_-is-set-to-0.patch
-- Applying patch add_debug_postfix_on_mingw.patch
-- Applying patch 0002-android-build-mingw.patch
-- Using source at C:/Dev/vcpkg/buildtrees/zlib/src/1.2.11-e9a093319e.clean
-- Configuring x86-windows
-- Building x86-windows-dbg
-- Building x86-windows-rel
-- Installing: C:/Dev/vcpkg/packages/zlib_x86-windows/share/zlib/vcpkg-cmake-wrapper.cmake
-- Fixing pkgconfig file: C:/Dev/vcpkg/packages/zlib_x86-windows/lib/pkgconfig/zlib.pc
-- Using cached msys-mingw-w64-i686-pkg-config-0.29.2-3-any.pkg.tar.zst.
-- Using cached msys-mingw-w64-i686-libwinpthread-git-9.0.0.6373.5be8fcd83-1-any.pkg.tar.zst.
-- Using msys root at C:/Dev/vcpkg-downloads/tools/msys2/9a1ec3f33446b195
-- Fixing pkgconfig file: C:/Dev/vcpkg/packages/zlib_x86-windows/debug/lib/pkgconfig/zlib.pc
-- Installing: C:/Dev/vcpkg/packages/zlib_x86-windows/share/zlib/copyright
-- Performing post-build validation
-- Performing post-build validation done
Elapsed time for zlib:x86-windows: 5.137 s

Total elapsed time: 7.36 s

The package zlib is compatible with built-in CMake targets:

    find_package(ZLIB REQUIRED)
    target_link_libraries(main PRIVATE ZLIB::ZLIB)

PS C:\Dev\vcpkg> ..\vcpkg-tool\out\build\x64-Debug\vcpkg.exe remove zlib
The following packages will be removed:
    zlib:x86-windows
Removing zlib:x86-windows (1/1)...
PS C:\Dev\vcpkg> ..\vcpkg-tool\out\build\x64-Debug\vcpkg.exe remove zlib
The following packages are not installed, so not removed:
    zlib:x86-windows
Removing zlib:x86-windows (1/1)...
PS C:\Dev\vcpkg>
```

* Built in implementation of microsoft/vcpkg#23477 .

Needs tests.

* Fix POSIX build failures.

* ref-ize SpecSummary as re	quested by @dg0yt

* Use XmlSerializer to generate xUnit results

* Localize touched messages

Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
@dg0yt dg0yt marked this pull request as draft June 11, 2022 20:23
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

error: checked-in files for librttopo have changed but the version was not updated
version: 1.1.0#5
old SHA: d747c88d429ff781b11627623d0958967f912a41
new SHA: 144a5d16e71f2ceec96373e3f26b71d704bb9bec
Did you remember to update the version or port version?
Use --overwrite-version to bypass this check
***No files were updated***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

error: checked-in files for librttopo have changed but the version was not updated
version: 1.1.0#5
old SHA: d747c88d429ff781b11627623d0958967f912a41
new SHA: 144a5d16e71f2ceec96373e3f26b71d704bb9bec
Did you remember to update the version or port version?
Use --overwrite-version to bypass this check
***No files were updated***

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

error: checked-in files for librttopo have changed but the version was not updated
version: 1.1.0#5
old SHA: d747c88d429ff781b11627623d0958967f912a41
new SHA: 144a5d16e71f2ceec96373e3f26b71d704bb9bec
Did you remember to update the version or port version?
Use --overwrite-version to bypass this check
***No files were updated***

@dg0yt
Copy link
Contributor Author

dg0yt commented Jun 11, 2022

https://dev.azure.com/vcpkg/public/_build/results?buildId=73559&view=ms.vss-test-web.build-test-results-tab
Apart from the outright bugs I solve with postprocessing, the tool's xunit output still isn't useful for AZP.

  • Durations are wrong.
  • While a PRs only installs "relevant" ports (and builds affected ports), the tool reports "Pass" for all ports which are not excluded.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a new experimental fast check for PR issues. Please let us know if this bot is helpful!

PRs must add only one version and must not modify any published versions

When making any changes to a library, the version or port-version in vcpkg.json or CONTROL must be modified.

error: checked-in files for librttopo have changed but the version was not updated
version: 1.1.0#5
old SHA: d747c88d429ff781b11627623d0958967f912a41
new SHA: 144a5d16e71f2ceec96373e3f26b71d704bb9bec
Did you remember to update the version or port version?
Use --overwrite-version to bypass this check
***No files were updated***

@dg0yt
Copy link
Contributor Author

dg0yt commented Jun 12, 2022

With the updated post-processing (which should be equivalent to microsoft/vcpkg-tool#585), it is better again.

BillyONeal added a commit to BillyONeal/vcpkg that referenced this pull request Jun 15, 2022
@BillyONeal
Copy link
Member

This is one of the most amazing contributions ever, thank you so much again!

BillyONeal added a commit that referenced this pull request Jun 15, 2022
* Update vcpkg-tool to 2022-06-15. See https://github.com/microsoft/vcpkg-tool/releases/tag/2022-06-15
* Add `=pass` entries from microsoft/vcpkg-tool#579
* Cherry pick XUnit output from #23477 which hooks up microsoft/vcpkg-tool#585 (Thanks again @dg0yt !)
* Update release process document now that we can do the full tree rebuild to test the tool release before signing.

Thank you:

@autoantwort 
@christophe-calmejane 
@JackBoosY 
@benmcmorran
@hmoffatt 
@klalumiere 
@Thomas1664 
@Neumann-A 
@AenBleidd

for your contributions!

Fixes #22686 .
Fixes #21800 .
Fixes #16216 .
Fixes #15836 .

Full tree rebuild testing this update is: https://dev.azure.com/vcpkg/public/_build/results?buildId=73664&view=results
@ras0219-msft ras0219-msft dismissed a stale review via ed4585c June 23, 2022 19:58
@JackBoosY
Copy link
Contributor

JackBoosY commented Jul 15, 2022

Any progress on this PR? (I will keep this PR open anyway)

@dg0yt
Copy link
Contributor Author

dg0yt commented Jul 15, 2022

Progress is at 137%. Xunit output was improved directly in vcpkg tool, and CI test result upload has been added in other PRs. For future improvements, I can open a new PR.

@dg0yt dg0yt closed this Jul 15, 2022
@dg0yt
Copy link
Contributor Author

dg0yt commented Jul 15, 2022

PS: I added a branch protection rule to my fork so that the history with the XML post-processing remains accessible for reference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category:infrastructure Pertaining to the CI/Testing infrastrucutre
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants