Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Test Failure] System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently on Alpine 3.17 #83101

Closed
rzikm opened this issue Mar 7, 2023 · 5 comments
Closed

[Test Failure] System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently on Alpine 3.17 #83101

rzikm opened this issue Mar 7, 2023 · 5 comments
Labels
area-System.Net.Quic test-failure
Milestone
9.0.0

Comments

@rzikm
Copy link
Member

rzikm commented Mar 7, 2023

e.g. https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-heads-main-120fd66ce615431389/System.Net.Quic.Functional.Tests/3/console.ed55dc16.log?helixlogtype=result

Outerloop test, 24 occurences in the last 7 days (as of 03-07)

----- start Wed Feb 22 12:59:27 UTC 2023 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Net.Quic.Functional.Tests.runtimeconfig.json --depsfile System.Net.Quic.Functional.Tests.deps.json xunit.console.dll System.Net.Quic.Functional.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 8 of 122 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently [FAIL]
      System.Net.Quic.QuicException : The server refused the connection.
      Stack Trace:
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(470,0): at System.Net.Quic.QuicConnection.HandleEventShutdownInitiatedByTransport(_SHUTDOWN_INITIATED_BY_TRANSPORT_e__Struct& data)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(569,0): at System.Net.Quic.QuicConnection.HandleConnectionEvent(QUIC_CONNECTION_EVENT& connectionEvent)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(598,0): at System.Net.Quic.QuicConnection.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_CONNECTION_EVENT* connectionEvent)
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ValueTaskSource.cs(176,0): at System.Net.Quic.ValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(312,0): at System.Net.Quic.QuicConnection.FinishConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(68,0): at System.Net.Quic.QuicConnection.ConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(73,0): at System.Net.Quic.QuicConnection.ConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(91,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.<>c__DisplayClass12_0.<<CreateConnectedStreamsAsync>b__2>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(568,0): at System.IO.Tests.StreamConformanceTests.WhenAllOrAnyFailed(Task task1, Task task2)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(80,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.CreateConnectedStreamsAsync()
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(137,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.CreateConnectedStreamsAsync()
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2471,0): at System.IO.Tests.ConnectedStreamConformanceTests.CopyToAsync_AllDataCopied(Int32 byteCount, Boolean useAsync)
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2503,0): at System.IO.Tests.ConnectedStreamConformanceTests.<Parallel_ReadWriteMultipleStreamsConcurrently>b__47_1()
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2501,0): at System.IO.Tests.ConnectedStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently()
        --- End of stack trace from previous location ---
  Finished:    System.Net.Quic.Functional.Tests
=== TEST EXECUTION SUMMARY ===
   System.Net.Quic.Functional.Tests  Total: 28, Errors: 0, Failed: 1, Skipped: 0, Time: 178.986s
/root/helix/work/workitem/e
----- end Wed Feb 22 13:02:27 UTC 2023 ----- exit code 1 ----------------------------------------------------------
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Mar 7, 2023
@ghost
Copy link

ghost commented Mar 7, 2023

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

e.g. https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-heads-main-120fd66ce615431389/System.Net.Quic.Functional.Tests/3/console.ed55dc16.log?helixlogtype=result

Outerloop test, 24 occurences in the last 7 days (as of 03-07)

----- start Wed Feb 22 12:59:27 UTC 2023 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Net.Quic.Functional.Tests.runtimeconfig.json --depsfile System.Net.Quic.Functional.Tests.deps.json xunit.console.dll System.Net.Quic.Functional.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 8 of 122 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently [FAIL]
      System.Net.Quic.QuicException : The server refused the connection.
      Stack Trace:
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(470,0): at System.Net.Quic.QuicConnection.HandleEventShutdownInitiatedByTransport(_SHUTDOWN_INITIATED_BY_TRANSPORT_e__Struct& data)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(569,0): at System.Net.Quic.QuicConnection.HandleConnectionEvent(QUIC_CONNECTION_EVENT& connectionEvent)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(598,0): at System.Net.Quic.QuicConnection.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_CONNECTION_EVENT* connectionEvent)
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ValueTaskSource.cs(176,0): at System.Net.Quic.ValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(312,0): at System.Net.Quic.QuicConnection.FinishConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(68,0): at System.Net.Quic.QuicConnection.ConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(73,0): at System.Net.Quic.QuicConnection.ConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(91,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.<>c__DisplayClass12_0.<<CreateConnectedStreamsAsync>b__2>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(568,0): at System.IO.Tests.StreamConformanceTests.WhenAllOrAnyFailed(Task task1, Task task2)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(80,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.CreateConnectedStreamsAsync()
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicStreamConnectedStreamConformanceTests.cs(137,0): at System.Net.Quic.Tests.QuicStreamConformanceTests.CreateConnectedStreamsAsync()
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2471,0): at System.IO.Tests.ConnectedStreamConformanceTests.CopyToAsync_AllDataCopied(Int32 byteCount, Boolean useAsync)
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2503,0): at System.IO.Tests.ConnectedStreamConformanceTests.<Parallel_ReadWriteMultipleStreamsConcurrently>b__47_1()
        /_/src/libraries/Common/tests/StreamConformanceTests/System/IO/StreamConformanceTests.cs(2501,0): at System.IO.Tests.ConnectedStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently()
        --- End of stack trace from previous location ---
  Finished:    System.Net.Quic.Functional.Tests
=== TEST EXECUTION SUMMARY ===
   System.Net.Quic.Functional.Tests  Total: 28, Errors: 0, Failed: 1, Skipped: 0, Time: 178.986s
/root/helix/work/workitem/e
----- end Wed Feb 22 13:02:27 UTC 2023 ----- exit code 1 ----------------------------------------------------------
Author: rzikm
Assignees: -
Labels:

area-System.Net.Quic
Milestone: -

@wfurt
Copy link
Member

wfurt commented Mar 7, 2023

probably same root cause as #82769

@ManickaP
Copy link
Member

ManickaP commented Mar 7, 2023

All occurrences are on net8.0-linux-Release-x64-CoreCLR_Release-(Alpine.317.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.17-helix-amd64, so another "baby" machine which cannot handle the load. And the test exercises parallelism, mortal combination for these type of failures.

@ManickaP
Copy link
Member

ManickaP commented Mar 7, 2023

Root cause issue is #55979

@ManickaP ManickaP removed the untriaged New issue has not been triaged by the area owner label Mar 7, 2023
@ManickaP ManickaP added this to the Future milestone Mar 7, 2023
@ManickaP ManickaP mentioned this issue Mar 7, 2023
Closed
@rzikm
Copy link
Member Author

rzikm commented May 3, 2024

Connections being refused were fixed by #98361.

@rzikm rzikm closed this as completed May 3, 2024
@karelz karelz modified the milestones: Future, 9.0.0 May 14, 2024
@github-actions github-actions bot locked and limited conversation to collaborators Jun 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
area-System.Net.Quic test-failure
Projects
None yet
Milestone
9.0.0
Development

No branches or pull requests
4 participants
@karelz @ManickaP @wfurt @rzikm