Failing test: Chrome UI Functional Tests.test/functional/apps/dashboard/dashboard_snapshots·js - dashboard app using current data dashboard snapshots compare area chart snapshot

[spalger]

This test failed in 4 PRs in the last 10 days.

https://kibana-ci.elastic.co/job/elastic+kibana+pull-request/3615/JOB=kibana-ciGroup3,node=immutable/testReport/junit/Chrome%20UI%20Functional%20Tests/test_functional_apps_dashboard_dashboard_snapshots%C2%B7js/dashboard_app_using_current_data_dashboard_snapshots_compare_area_chart_snapshot/

Stacktrace
        Error: expected 0.058620450606585786 to be below 0.05
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.lessThan.Assertion.below (packages/kbn-expect/expect.js:318:8)
    at Function.lessThan (packages/kbn-expect/expect.js:504:15)
    at Context.lessThan (test/functional/apps/dashboard/dashboard_snapshots.js:81:39)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Baseline:

Session:

[elasticmachine]

Pinging @elastic/kibana-test-triage

[elasticmachine]

Pinging @elastic/kibana-app

[spalger]

Skipped

master: 8a6ac54 + 0f5bfc0
7.x/7.3: 2ceab54 + 1288e82

[LeeDr]

I tried to unskip this test. If the problem were only the notifications shown in the Session screenshot above it should have been an easy fix to closeToast() before the screenshot, but things seem to have gotten worse. I added debugging steps in #46311 to capture a few screenshots leading up to the final one.

First screenshot when we've gone to Fullscreen mode looks good;

Second screenshot was just after a 5 second sleep to see if it was not rendered completely in the first screenshot but it was the same.

Third screenshot shows the context menu open and looks good;

The only step after ^ that screenshot is to click the Full screen context menu item clickExpandPanelToggle , but the next screenshot that fails the test is not even in full screen mode anymore?!?!

And this test passes locally for me every time!