Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test-browser CI job is extremely flaky #10383

Closed
mourner opened this issue Feb 13, 2021 · 2 comments · Fixed by #10385
Closed

test-browser CI job is extremely flaky #10383

mourner opened this issue Feb 13, 2021 · 2 comments · Fixed by #10385

Comments

@mourner
Copy link
Member

mourner commented Feb 13, 2021

The test-browser Circle CI job fails about 60% of the time in recent days, although it always passes locally. Example failure. Usually it passes one-two tests, then fails with the following error:

unknown error: Chrome failed to start: exited abnormally. (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

Sometimes it fails in Firefox rather than Chrome, so it's generally pretty random. It might be related to merging #10367, but I don't see why it would randomly fail as a result of these code changes. Another hypothesis is circleci/node:14.15-browsers circle image having faulty browser set up that crashes easily. 🤷‍♂️

It's really annoying having to restart the failed workflow jobs 2-3 times until it passes before merging a PR, so we should investigate, or in the absense of ideas, temporarily disable the job.

@mourner
Copy link
Member Author

mourner commented Feb 15, 2021

Tried upgrading selenium-webdriver dependency but it didn't help. At this point I'm not sure how to approach this — perhaps it would be best to disable the job until we figure it out. After all, the package is still in alpha, and the tests there are just minimal samples (#9245) which we've never expanded on. cc @kkaefer

@mourner
Copy link
Member Author

mourner commented Feb 15, 2021

Looks like it's running fine now after upgrading the Circle image in #10385.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant