Failing ES Promotion: APM specs correlations latency correlations space with no features disabled loads the correlation results

[tylersmalley]

This failure is preventing the promotion of the current Elasticsearch nightly snapshot. We will plan on skipping tomorrow if left un-resolved to unblock downstream teams relying on an up-to-date ES snapshot.

For more information on the Elasticsearch snapshot promotion process including how to reproduce using the unverified nightly ES build: https://www.elastic.co/guide/en/kibana/master/development-es-snapshots.html

Failed promotion job: https://buildkite.com/elastic/kibana-elasticsearch-snapshot-verify/builds/241

This appears to be caused by elastic/elasticsearch@b968fcb (cc @not-napoleon). Will need someone from APM to verify if it's an issue within Kibana or not.

Error: retry.try timeout: Error: expected 'Progress: 0%' to equal 'Progress: 100%'
    at Assertion.assert (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/node_modules/@kbn/expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/node_modules/@kbn/expect/expect.js:227:8)
    at Assertion.be (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/node_modules/@kbn/expect/expect.js:69:22)
    at /opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/x-pack/test/functional/apps/apm/correlations/latency_correlations.ts:150:58
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at runAttempt (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry_for_success.ts:29:15)
    at retryForSuccess (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry_for_success.ts:68:21)
    at RetryService.try (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry.ts:31:12)
    at Context.<anonymous> (test/functional/apps/apm/correlations/latency_correlations.ts:145:9)
    at Object.apply (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
    at onFailure (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry_for_success.ts:59:13)
    at RetryService.try (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/test/common/services/retry/retry.ts:31:12)
    at Context.<anonymous> (test/functional/apps/apm/correlations/latency_correlations.ts:145:9)
    at Object.apply (/opt/local-ssd/buildkite/builds/kb-cigroup-6-82496a07dbdbb652/elastic/kibana-elasticsearch-snapshot-verify/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)

[elasticmachine]

Pinging @elastic/apm-ui (Team:apm)

[sorenlouv]

@walterra or @qn895: it looks like this test is failing:

kibana/x-pack/test/functional/apps/apm/correlations/latency_correlations.ts

Line 150 in 1d71d42

expect(apmLatencyCorrelationsProgressTitle).to.be('Progress: 100%');

Can you take a look or help me fix this?

[walterra]

Thanks for the ping, we will pick this up and report back here.

[walterra]

We identified the root cause and I'm working on a fix.

[walterra]

The fix #114833 has been merged and backported.