Failing test: Firefox UI Functional Tests - Console.test/functional/apps/console/_variables·ts - console app Console variables with variables in request body should send a successful request

[kibanamachine]

A test failed on a tracked branch

Error: retry.try timeout: Error: expected '400' to sort of equal 200
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at _variables.ts:68:29
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:68:21)
    at RetryService.try (retry.ts:31:12)
    at Context.<anonymous> (_variables.ts:66:9)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.try (retry.ts:31:12)
    at Context.<anonymous> (_variables.ts:66:9)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - 8.8

[elasticmachine]

Pinging @elastic/platform-deployment-management (Team:Deployment Management)

[kibanamachine]

New failure: CI Build - 8.8

[kibanamachine]

New failure: CI Build - 8.8

[kibanamachine]

New failure: CI Build - main

[jbudz]

/skip

[kibanamachine]

Skipped

8.8: 35f824a
main: 2ef9994

[alisonelizabeth]

I did a quick manual test of the variable functionality in Console and everything worked as expected. Removing the blocker tag for now, we will need to investigate the test itself.

[alisonelizabeth]

In #160442, I re-enabled this test to run on Chrome.

[alisonelizabeth]

I'm going to close this issue since the test is running on Chrome. I think this gives us sufficient coverage.

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[delanni]

@sabarasaba - did anything improve in terms of the FF stability? The test seems to be still flaking out recently, and I've seen you recently re-enabled this: https://github.com/elastic/kibana/pull/190698/files#diff-0885594a1539654c1240dcc0a46e1888302985dcd5b4898039ecac7cbf8c2eeeR19

[sabarasaba]

I was about to skip it again, I've ran it through the flaky test runner 100x few times and was passing just fine before I merged it. I'm really unsure of why its failing again :(

[delanni]

Let's put it back to skipped then

[sabarasaba]

PR for that: #193288

[delanni]

on the screenshot of the error, it seems that the error is with parsing a JSON that contains a \u0009 before "query" - I checked and \u0009 is a tab character, so probably this line in the code is interpreted differently:

await PageObjects.console.enterText(`{\n\t"query": "\${query1}"`);

Should we try without the \n\t? It's still a valid JSON

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

New failure: kibana-on-merge - main

[jbudz]

/skip

[kibanamachine]

New failure: kibana-on-merge - main

[kibanamachine]

Skipped

main: aa4bce0

[kibanamachine]

New failure: kibana-on-merge - main

[sabarasaba]

Adressed with #193508