[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #101617

lewing · 2024-04-26T17:46:25Z

Release Note Category

Feature changes/additions
Bug fixes
Internal Infrastructure Improvements

Release Note Description

Requires increasing the shared memory. This edit of description is done to make PR's pipeline pass Enforce GitHub issue link presence step.

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=656594
Build error leg or test failing: WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
Pull request: #101538

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=656594
Error message validated: [crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/26/2024 5:46:49 PM UTC

Report

Build	Definition	Test	Pull Request
663429	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101640
663389	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101808
663336	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101762
663287	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101781
663268	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101800
663262	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100951
663222	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101797
663200	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101624
662930	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101761
663164	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101640
663076	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100951
663068	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101717
662942	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101684
662938	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100951
662949	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101767
662830	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
662542	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101761
662574	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100619
662347	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101624
662312	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#99490
662296	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101753
662281	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
662225	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
662158	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101761
662154	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101277
662112	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101451
662100	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101753
662046	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101732
661923	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
662033	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101767
661965	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101766
661299	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101745
661873	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101762
661888	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101716
661869	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101624
661816	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101717
661799	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101443
661662	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100266
661671	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
661154	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101715
661633	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
661543	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101743
661229	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101735
661476	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101755
661485	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
661442	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101743
661457	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101732
661428	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101753
661405	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100030
661384	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101752
661374	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101751
661304	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101674
661247	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101740
661214	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101277
661111	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
660990	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101631
660981	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101624
660955	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101451
660967	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101212
661010	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101693
661006	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101693
660940	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101725
661019	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101318
660849	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
660861	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101674
660836	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100619
660793	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101684
660756	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101712
660679	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101717
660693	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101660
660723	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101716
660615	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101715
660246	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101705
660588	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100823
660568	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#99818
660529	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101653
660471	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101693
660460	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101712
660440	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100266
660399	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
660391	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101671
660374	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
660018	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101318
660346	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101162
660271	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101626
660253	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
660135	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
660111	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101626
660077	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101212
660071	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101702
659911	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101624
659901	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
659840	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101626
659826	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101196
659861	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101693
659851	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution
659792	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#100266
659789	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101690
659721	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101212
659694	dotnet/runtime	WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution	#101151
Displaying 100 of 181 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	181

The text was updated successfully, but these errors were encountered:

dotnet-policy-service · 2024-04-26T17:46:53Z

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries
See info in area-owners.md if you want to be subscribed.

dotnet-policy-service · 2024-04-26T17:47:08Z

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

lewing · 2024-05-02T17:25:38Z

test is now disabled, failures should stop rolling in soon

24-Hour Hit Count	7-Day Hit Count	1-Month Count
24	175	175

pavelsavara · 2024-05-14T13:34:12Z

This has some hints https://stackoverflow.com/questions/49734915/failed-to-decode-response-from-marionette-message-in-python-firefox-headless-s

docker memory need be at least 2gb
or there are firefox zombies from previous run

pavelsavara · 2024-05-16T16:02:39Z

note from @akoeplinger

https://github.com/dotnet/aspnetcore/blob/98c6c2917fc7e2c38d18862b31430dc5718d44b7/src/Components/benchmarkapps/Wasm.Performance/Driver/Selenium.cs#L72-L74

pavelsavara · 2024-05-16T16:06:05Z

https://stackoverflow.com/questions/55656748/running-firefox-in-headless-mode-on-windows-container-with-windows-servercore

akoeplinger · 2024-05-16T16:29:06Z

Yeah looks like we'd need a way to specify either --shm-size or mount the host's /dev/shm as a volume into the container.

Here's where we run docker in helix: https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines?path=/resources/helix-scripts/helix/dockerhelper.py&version=GBmain&line=162&lineEnd=177&lineStartColumn=1&lineEndColumn=1&lineStyle=plain&_a=contents

ilonatommy · 2024-06-11T13:42:59Z

All LibraryTests_HybridGlobalization on firefox fail because of it.

Yeah looks like we'd need a way to specify either --shm-size.

The link you pasted gives the answer, docker's client run function has shm_size parameter. I can make this change if it would be an accepted solution.
https://docker-py.readthedocs.io/en/stable/containers.html?highlight=shm_size#docker.models.containers.ContainerCollection.run

edit: by default it's 64MB.

akoeplinger · 2024-06-12T09:13:34Z

Yeah I think adding the parameter with e.g. 2g is the best option we have. You'll need to send a PR to the dotnet-helix-machines repo I linked above and wait for dnceng to get it rolled out.

ilonatommy · 2024-06-12T09:23:07Z

https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines/pullrequest/40290

ilonatommy · 2024-06-24T08:12:15Z

It is not caught because runtime-wasm is excluded from Build Analysis step and the failures happen on runtime-wasm (Build browser-wasm windows Release LibraryTests_HybridGlobalization) e.g. log

Console log: 'WasmTestOnFirefox-ST-Common.Tests' from job 1443fe94-33bc-46e6-bbf7-575bc33b2e86 (windows.amd64.server2022.open.rt) using docker image mcr.microsoft.com/dotnet-buildtools/prereqs:windowsservercore-ltsc2022-helix-webassembly on a002B1J
running %HELIX_CORRELATION_PAYLOAD%\scripts\1a81aacd35e2468bb85a763d39aec6a5\execute.cmd in C:\h\w\ABFC097D\w\B776098D\e max 1800 seconds
....
JavaScript error: resource://gre/modules/WindowsLaunchOnLogin.sys.mjs, line 28: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIWindowsRegKey.open]
JavaScript error: resource://gre/modules/WindowsLaunchOnLogin.sys.mjs, line 28: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIWindowsRegKey.open]
[18:52:33] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette
                    at OpenQA.Selenium.Remote.RemoteWebDriver.UnpackAndThrowOnError(Response errorResponse)
                    at OpenQA.Selenium.Remote.RemoteWebDriver.Execute(String driverCommandToExecute, Dictionary`2 parameters)
                    at OpenQA.Selenium.Remote.RemoteWebDriver.StartSession(ICapabilities desiredCapabilities)
                    at OpenQA.Selenium.Remote.RemoteWebDriver..ctor(ICommandExecutor commandExecutor, ICapabilities desiredCapabilities)
                    at OpenQA.Selenium.Firefox.FirefoxDriver..ctor(FirefoxDriverService service, FirefoxOptions options, TimeSpan commandTimeout)
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.<>c__DisplayClass13_0.<GetFirefoxDriver>b__1(FirefoxDriverService driverService) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 146
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.CreateWebDriver[TDriverService](Func`1 getDriverService, Func`2 getDriver) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 308
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.CreateWebDriver[TDriverService](Func`1 getDriverService, Func`2 getDriver) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 313
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.GetFirefoxDriver(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 144
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.InvokeInternal(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 72
                    at Microsoft.DotNet.XHarness.CLI.Commands.XHarnessCommand`1.Invoke(IEnumerable`1 arguments) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/XHarnessCommand.cs:line 145
XHarness exit code: 71 (GENERAL_FAILURE)

ilonatommy · 2024-06-24T15:24:06Z

Waiting for the results of tests after the changes get propagated: #104017

lewing added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels Apr 26, 2024

lewing added this to the 9.0.0 milestone Apr 26, 2024

dotnet-issue-labeler bot added the area-Infrastructure-libraries label Apr 26, 2024

lewing added arch-wasm WebAssembly architecture os-browser Browser variant of arch-wasm area-Infrastructure-mono and removed area-Infrastructure-libraries labels Apr 26, 2024

lewing removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Apr 26, 2024

maraf mentioned this issue May 2, 2024

[browser] Don't run AOT smoke tests on Firefox #101802

Merged

lewing assigned pavelsavara May 2, 2024

pavelsavara removed the Known Build Error Use this to report build issues in the .NET Helix tab label May 15, 2024

pavelsavara modified the milestones: 9.0.0, Future May 15, 2024

pavelsavara mentioned this issue May 17, 2024

test firefox shm #102365

Closed

ilonatommy mentioned this issue May 17, 2024

[browser] Separate hybrid globalization JS code to es6 module #101543

Merged

This was referenced Jun 13, 2024

[CI] Test increase shared mem from 64MB to 2GB. #103407

Closed

[wasm][firefox] Test crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #103706

Closed

ilonatommy mentioned this issue Jun 24, 2024

Close all tabs before quitting. dotnet/xharness#1221

Merged

ilonatommy closed this as completed in dotnet/xharness#1221 Jun 24, 2024

ilonatommy reopened this Jun 24, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #101617

[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #101617

lewing commented Apr 26, 2024 •

edited by ilonatommy

Loading

dotnet-policy-service bot commented Apr 26, 2024

dotnet-policy-service bot commented Apr 26, 2024

lewing commented May 2, 2024

pavelsavara commented May 14, 2024

pavelsavara commented May 16, 2024

pavelsavara commented May 16, 2024

akoeplinger commented May 16, 2024 •

edited

Loading

ilonatommy commented Jun 11, 2024 •

edited

Loading

akoeplinger commented Jun 12, 2024 •

edited

Loading

ilonatommy commented Jun 12, 2024

ilonatommy commented Jun 24, 2024

ilonatommy commented Jun 24, 2024 •

edited

Loading

[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #101617

[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette #101617

Comments

lewing commented Apr 26, 2024 • edited by ilonatommy Loading

Release Note Category

Release Note Description

Build Information

Error Message

Known issue validation

Report

Summary

dotnet-policy-service bot commented Apr 26, 2024

dotnet-policy-service bot commented Apr 26, 2024

lewing commented May 2, 2024

pavelsavara commented May 14, 2024

pavelsavara commented May 16, 2024

pavelsavara commented May 16, 2024

akoeplinger commented May 16, 2024 • edited Loading

ilonatommy commented Jun 11, 2024 • edited Loading

akoeplinger commented Jun 12, 2024 • edited Loading

ilonatommy commented Jun 12, 2024

ilonatommy commented Jun 24, 2024

ilonatommy commented Jun 24, 2024 • edited Loading

lewing commented Apr 26, 2024 •

edited by ilonatommy

Loading

akoeplinger commented May 16, 2024 •

edited

Loading

ilonatommy commented Jun 11, 2024 •

edited

Loading

akoeplinger commented Jun 12, 2024 •

edited

Loading

ilonatommy commented Jun 24, 2024 •

edited

Loading