Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

3 System.Diagnostics tests failing - System.FormatException : The input is not a valid Base-64 #76140

Open
karelz opened this issue Sep 24, 2022 · 9 comments
Open

3 System.Diagnostics tests failing - System.FormatException : The input is not a valid Base-64 #76140

karelz opened this issue Sep 24, 2022 · 9 comments
Labels
area-System.Diagnostics.Process disabled-test The test is disabled in source code against the issue Known Build Error Use this to report build issues in the .NET Helix tab os-android
Milestone
Future

Comments

@karelz
Copy link
Member

karelz commented Sep 24, 2022 •
edited by build-analysis bot
Loading

Affected tests:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - System.Diagnostics.Tests.ProcessStartInfoTests.EnvironmentGetEnvironmentVariablesIsCaseSensitive

Regression on 9/21 - first occurrence in PR 25181

Runfo queries:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - last 30 days

As of 9/24 there are 10 hits on the same builds in each test:

  • All 10 hits on platform net7.0-Linux-Release-arm64-Mono_Release_LinuxBionic-Windows.10.Amd64.Android.Open
Day Run Logs
9/23 Rolling run 28538 (7.0) Console
9/23 Rolling run 28539 (release/5 - ???) Console
9/23 PR 28221 (7.0) Console
9/23 PR 27908 (main) Console
9/22 Rolling run 27273 (release/5 - ???) Console
9/22 Rolling run 27269 (7.0) Console
9/22 Rolling run 26575 (7.0-rc2) Console
9/22 PR 25945 (main) Console
9/21 Rolling run 25911 (7.0) Console
9/21 PR 25181 (main) Console 
 {
    "ErrorMessage" : " The input is not a valid Base-64 string as it contains a non-base 64 character",
    "BuildRetry": false
 }

Report

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 0

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
@karelz karelz added area-System.Diagnostics blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' labels Sep 24, 2022
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Sep 24, 2022
@ghost
Copy link

ghost commented Sep 24, 2022

Tagging subscribers to this area: @tommcdon
See info in area-owners.md if you want to be subscribed.

Issue Details

Affected tests:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - System.Diagnostics.Tests.ProcessStartInfoTests.EnvironmentGetEnvironmentVariablesIsCaseSensitive

Regression on 9/21 - first occurrence in PR 25181

Runfo queries:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - last 30 days

As of 9/24 there are 10 hits on the same builds in each test:

Day Run Logs
9/23 Rolling run 28538 (7.0) Console
9/23 Rolling run 28539 (release/5 - ???) Console
9/23 PR 28221 (7.0) Console
9/23 PR 27908 (main) Console
9/22 Rolling run 27273 (release/5 - ???) Console
9/22 Rolling run 27269 (7.0) Console
9/22 Rolling run 26575 (7.0-rc2) Console
9/22 PR 25945 (main) Console
9/21 Rolling run 25911 (7.0) Console
9/21 PR 25181 (main) Console
Author: karelz
Assignees: -
Labels:

area-System.Diagnostics, blocking-clean-ci
Milestone: -

@karelz
Copy link
Member Author

karelz commented Sep 24, 2022

@carlossanlop any idea what is the release/5 branch? Is it 5.0.x servicing?

@ghost
Copy link

ghost commented Sep 24, 2022

Tagging subscribers to 'arch-android': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

Affected tests:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - System.Diagnostics.Tests.ProcessStartInfoTests.EnvironmentGetEnvironmentVariablesIsCaseSensitive

Regression on 9/21 - first occurrence in PR 25181

Runfo queries:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - last 30 days

As of 9/24 there are 10 hits on the same builds in each test:

  • All 10 hits on platform net7.0-Linux-Release-arm64-Mono_Release_LinuxBionic-Windows.10.Amd64.Android.Open
Day Run Logs
9/23 Rolling run 28538 (7.0) Console
9/23 Rolling run 28539 (release/5 - ???) Console
9/23 PR 28221 (7.0) Console
9/23 PR 27908 (main) Console
9/22 Rolling run 27273 (release/5 - ???) Console
9/22 Rolling run 27269 (7.0) Console
9/22 Rolling run 26575 (7.0-rc2) Console
9/22 PR 25945 (main) Console
9/21 Rolling run 25911 (7.0) Console
9/21 PR 25181 (main) Console
Author: karelz
Assignees: -
Labels:

area-System.Diagnostics, blocking-clean-ci, os-android, untriaged
Milestone: -

@steveisok
Copy link
Member

/cc @mdh1418

@steveisok
Copy link
Member

All 3 of the listed tests require RemoteExecutor support, which is not supported on Android and I think extends to LB.

@runfoapp runfoapp bot mentioned this issue Sep 26, 2022
Closed
@carlossanlop
Copy link
Member

@carlossanlop any idea what is the release/5 branch? Is it 5.0.x servicing?

@karelz for runtime specifically, 5.0 is handled internally only, since it's out of support. Will send you the branch via chat.

@steveisok steveisok removed the untriaged New issue has not been triaged by the area owner label Sep 28, 2022
@steveisok steveisok added this to the 8.0.0 milestone Sep 28, 2022
@jkotas jkotas added the Known Build Error Use this to report build issues in the .NET Helix tab label Oct 1, 2022
@jkotas
Copy link
Member

jkotas commented Oct 1, 2022

All 3 of the listed tests require RemoteExecutor support, which is not supported on Android and I think extends to LB.

It is not what the code says: https://github.com/dotnet/arcade/blob/5fb434d9e8b99ff4d64381ef2f0c577b314a56e2/src/Microsoft.DotNet.RemoteExecutor/src/RemoteExecutor.cs#L99-L108

@steveisok steveisok mentioned this issue Oct 1, 2022
Closed
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Oct 1, 2022
@simonrozsival simonrozsival mentioned this issue Oct 3, 2022
Merged
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Oct 4, 2022
steveisok pushed a commit to steveisok/runtime that referenced this issue Oct 4, 2022
[LinuxBionic] Disable failing ProcessStartInfo tests on CI
ab2e114 
A few ProcessStartInfo tests sometimes fail for strange reasons. Disabling until we can look further.

Addresses dotnet#76140
@steveisok steveisok mentioned this issue Oct 4, 2022
Merged
adamsitnik pushed a commit that referenced this issue Oct 4, 2022
@steveisok
[LinuxBionic] Disable failing ProcessStartInfo tests on CI (#76585)
89c7184 
A few ProcessStartInfo tests sometimes fail for strange reasons. Disabling until we can look further.

Addresses #76140

Co-authored-by: Steve Pfister <steve.pfister@microsoft.com>
@filipnavara filipnavara added the disabled-test The test is disabled in source code against the issue label Oct 4, 2022
@akoeplinger akoeplinger mentioned this issue Oct 4, 2022
Closed
@steveisok steveisok removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Feb 2, 2023
@ghost
Copy link

ghost commented May 11, 2023

Tagging subscribers to this area: @dotnet/area-system-diagnostics-process
See info in area-owners.md if you want to be subscribed.

Issue Details

Affected tests:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - System.Diagnostics.Tests.ProcessStartInfoTests.ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - System.Diagnostics.Tests.ProcessStartInfoTests.EnvironmentGetEnvironmentVariablesIsCaseSensitive

Regression on 9/21 - first occurrence in PR 25181

Runfo queries:

  • ProcessStartInfoEnvironmentDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • ProcessStartInfoEnvironmentVariablesDoesNotThrowForCaseSensitiveDuplicates - last 30 days
  • EnvironmentGetEnvironmentVariablesIsCaseSensitive - last 30 days

As of 9/24 there are 10 hits on the same builds in each test:

  • All 10 hits on platform net7.0-Linux-Release-arm64-Mono_Release_LinuxBionic-Windows.10.Amd64.Android.Open
Day Run Logs
9/23 Rolling run 28538 (7.0) Console
9/23 Rolling run 28539 (release/5 - ???) Console
9/23 PR 28221 (7.0) Console
9/23 PR 27908 (main) Console
9/22 Rolling run 27273 (release/5 - ???) Console
9/22 Rolling run 27269 (7.0) Console
9/22 Rolling run 26575 (7.0-rc2) Console
9/22 PR 25945 (main) Console
9/21 Rolling run 25911 (7.0) Console
9/21 PR 25181 (main) Console 
 {
    "ErrorMessage" : " The input is not a valid Base-64 string as it contains a non-base 64 character",
    "BuildRetry": false
 }

Report

Build Definition Test Pull Request
269752 dotnet/runtime normal-System.Runtime.Extensions.Tests.WorkItemExecution #85920
268070 dotnet/runtime System.Tests.ConvertTests.Base64_AllMethodsRoundtripConsistently #85920
266368 dotnet/runtime normal-System.Runtime.Extensions.Tests.WorkItemExecution #85920
261505 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
255151 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
253657 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
250732 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
248101 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
243650 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution #82045
241763 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution #82045
236899 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution
235129 dotnet/runtime System.Diagnostics.Process.Tests.WorkItemExecution

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 3 12
Author: karelz
Assignees: -
Labels:

area-System.Diagnostics, area-System.Diagnostics.Process, disabled-test, os-android, Known Build Error
Milestone: 8.0.0

@adamsitnik
Copy link
Member

I don't understand one thing: in #76585 @steveisok has disabled this test by applying following attribute:

[ActiveIssue("https://github.com/dotnet/runtime/issues/76140", TestPlatforms.LinuxBionic)]

but it keeps failing for Mono_Release_LinuxBionic-Windows.10.Amd64.Android.Open

Why is that?

@steveisok steveisok removed this from the 8.0.0 milestone Aug 8, 2023
@steveisok steveisok added this to the Future milestone Aug 8, 2023
@build-analysis build-analysis bot removed this from the Future milestone Nov 15, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Nov 15, 2023
@akoeplinger akoeplinger added this to the Future milestone Nov 24, 2023
@ghost ghost removed the untriaged New issue has not been triaged by the area owner label Nov 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area-System.Diagnostics.Process disabled-test The test is disabled in source code against the issue Known Build Error Use this to report build issues in the .NET Helix tab os-android
Projects
None yet
Milestone
Future
Development

Successfully merging a pull request may close this issue.

[LinuxBionic] Disable RemoteExecutor during test runs steveisok/runtime
8 participants
@steveisok @carlossanlop @akoeplinger @filipnavara @karelz @adamsitnik @jkotas @tommcdon