-
Notifications
You must be signed in to change notification settings - Fork 225
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upgrade to the latest version of Cypress #5976
Conversation
cypress/integration/specialFeatures/cookieBanner/testsForCanonicalOnly.js
Outdated
Show resolved
Hide resolved
The parseInt() function has better error handling.
Not currently looking into the issue as I am waiting on space to become available on CodeBuild, but last time I ran the job we had 24 tests fail for a single service only, test time did not change significantly. |
…nto cypress-upgrade
I'm still looking into this in between other things but here's what I got so far. I ran the front page e2e's on version 3.8.1 (current) and 4.3.0 (latest version available), with 3.8.1Run 1: 3413s => 57min Average: (3413 + 3477 + 3449)/3 = 3446.333333333 => 3446s => 57min 4.3.0Run 1: 4217s => 1 hour 10 min Average: (4217 + 4223 + 4368)/3 = 4269.333333333 => 4269s => 1 hour 11min So difference of about 14 minutes for front page tests. This was all done locally, so tests ran slower than on CodeBuild. Currently the front page tests take about 25 minutes (on TEST, not LIVE) on CodeBuild, so with version 4.3.0, front page tests would take roughly 32 minutes. Here are some predictions for how long the tests will take with Cypress@4.3.0 on CodeBuild based on how long they run for now: Also found these two issues:
which shows we're not the only ones experiencing this issue |
Thanks for the analysis Jamie, I'm happy to update cypress knowing it will add time to our runs for the moment, then we can look to streamline and improve our tests after. |
+1 thanks Jamie and Fahad. I think we should push ahead with this too. |
Revert back to the registry.npmjs url.
Resolves https://github.com/bbc/simorgh-infrastructure/issues/837
Overall change:
Upgrade to the latest version of Cypress
Code changes:
Testing:
CYPRESS_APP_ENV=local CYPRESS_SMOKE=false npm run test:e2e:interactive
)