Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll #85081

Closed
v-wenyuxu opened this issue Apr 20, 2023 · 10 comments
Assignees
Labels
arch-x64 arch-x86 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI disabled-test The test is disabled in source code against the issue os-linux Linux OS (any supported distro) os-mac-os-x macOS aka OSX os-windows
Milestone

Comments

@v-wenyuxu
Copy link

Run: runtime-coreclr outerloop 20230419.2

Failed test:

R2R-CG2 windows x64 Checked @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows x64 Checked no_tiered_compilation @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows x86 Checked no_tiered_compilation @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows arm64 Checked no_tiered_compilation @ Windows.11.Arm64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows arm Checked no_tiered_compilation @ Windows.11.Arm64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 linux arm64 Checked no_tiered_compilation @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
... ...

Error message:

Assert.Equal() Failure
Expected: 100
Actual:   0


Stack trace
   at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/xunit.assert/Asserts/EqualityAsserts.cs:line 96
   at Xunit.Assert.Equal[T](T expected, T actual) in /_/src/xunit.assert/Asserts/EqualityAsserts.cs:line 63
   at Program.<<Main>$>g__TestExecutor7|0_6(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
@v-wenyuxu v-wenyuxu added arch-arm64 arch-x86 os-linux Linux OS (any supported distro) os-mac-os-x macOS aka OSX os-windows arch-x64 blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels Apr 20, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Apr 20, 2023
@dotnet-issue-labeler dotnet-issue-labeler bot added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Apr 20, 2023
@ghost
Copy link

ghost commented Apr 20, 2023

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch, @kunalspathak
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime-coreclr outerloop 20230419.2

Failed test:

R2R-CG2 windows x64 Checked @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows x64 Checked no_tiered_compilation @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows x86 Checked no_tiered_compilation @ Windows.10.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows arm64 Checked no_tiered_compilation @ Windows.11.Arm64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 windows arm Checked no_tiered_compilation @ Windows.11.Arm64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 linux arm64 Checked no_tiered_compilation @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

R2R-CG2 osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open

- JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
... ...

Error message:

Assert.Equal() Failure
Expected: 100
Actual:   0


Stack trace
   at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/xunit.assert/Asserts/EqualityAsserts.cs:line 96
   at Xunit.Assert.Equal[T](T expected, T actual) in /_/src/xunit.assert/Asserts/EqualityAsserts.cs:line 63
   at Program.<<Main>$>g__TestExecutor7|0_6(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Author: v-wenyuxu
Assignees: -
Labels:

arch-arm64, arch-x86, os-linux, os-mac-os-x, os-windows, arch-x64, area-CodeGen-coreclr, untriaged, blocking-outerloop

Milestone: -

@BruceForstall BruceForstall removed the untriaged New issue has not been triaged by the area owner label Apr 20, 2023
@BruceForstall BruceForstall added this to the 8.0.0 milestone Apr 20, 2023
@BruceForstall
Copy link
Member

@TIHan Note: blocking outerloop

trylek added a commit to trylek/runtime that referenced this issue Apr 20, 2023
@BruceForstall BruceForstall added disabled-test The test is disabled in source code against the issue and removed arch-arm64 blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels Apr 21, 2023
@TIHan
Copy link
Member

TIHan commented Apr 21, 2023

This is extremely strange that this is failing across all archs. At the moment, I'm not able to get this test to fail locally on arm64 and x64.

@BruceForstall
Copy link
Member

Make sure you run the test wrapper script with:

set RunCrossGen2=1

To repro, it's possible you may also need to also crossgen2 compile your framework libraries. Note that the CI generates CORE_ROOT using:

src/tests/build.cmd generatelayoutonly log Layout  crossgen2 checked x64  -priority=1  /p:LibrariesConfiguration=Release 

In particular, passing "crossgen2" does this.

@kunalspathak kunalspathak added the blocking-clean-ci-optional Blocking optional rolling runs label Apr 24, 2023
@kunalspathak
Copy link
Member

This has stopped failing for outerloop because we disabled it for crossgen2 scenarios in #85123, but this is still failing in jitstressregs.

@BruceForstall
Copy link
Member

This has stopped failing for outerloop because we disabled it for crossgen2 scenarios in #85123, but this is still failing in jitstressregs.

We should change the test exclusion to exclude it all the time, not just for crossgen2 scenarios, unless a fix is immediately available.

@kunalspathak
Copy link
Member

This has stopped failing for outerloop because we disabled it for crossgen2 scenarios in #85123, but this is still failing in jitstressregs.

We should change the test exclusion to exclude it all the time, not just for crossgen2 scenarios, unless a fix is immediately available.

@TIHan - please do whatever is appropriate.

@BruceForstall BruceForstall removed the blocking-clean-ci-optional Blocking optional rolling runs label Apr 26, 2023
@BruceForstall BruceForstall added blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs and removed disabled-test The test is disabled in source code against the issue labels Apr 27, 2023
@BruceForstall
Copy link
Member

@TIHan This is failing in outerloop again. It appears #85381 did not work.

@BruceForstall
Copy link
Member

@TIHan Did #85495 fix the disabling? So we can remove blocking-outerloop but add back disabled-test?

@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr crossgen2 20230427.1

Failed tests:

R2R-CG2 osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 linux x64 Checked @ Ubuntu.1804.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 linux x64 Checked no_tiered_compilation @ Ubuntu.1804.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 windows x64 Checked no_tiered_compilation @ Windows.10.Amd64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 linux arm64 Checked no_tiered_compilation @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 windows arm64 Checked @ Windows.11.Arm64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 osx arm64 Checked no_tiered_compilation @ OSX.1200.ARM64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 osx arm64 Checked @ OSX.1200.ARM64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll
R2R-CG2 windows arm64 Checked no_tiered_compilation @ Windows.11.Arm64.Open
    - JIT/Regression/JitBlue/Runtime_84693/Runtime_84693/Runtime_84693.dll

Error message:

 Assert.Equal() Failure
Expected: 100
Actual:   0

Stack trace:

    at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/xunit.assert/Asserts/EqualityAsserts.cs:line 96
   at Program.<<Main>$>g__TestExecutor6|0_5(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@JulieLeeMSFT JulieLeeMSFT added disabled-test The test is disabled in source code against the issue and removed blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels May 8, 2023
@TIHan TIHan closed this as completed Jul 20, 2023
@ghost ghost locked as resolved and limited conversation to collaborators Aug 19, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
arch-x64 arch-x86 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI disabled-test The test is disabled in source code against the issue os-linux Linux OS (any supported distro) os-mac-os-x macOS aka OSX os-windows
Projects
None yet
Development

No branches or pull requests

5 participants