Failing test: X-Pack Reporting API Integration Tests.x-pack/test/reporting_api_integration/reporting/usage·ts - Reporting APIs reporting usage "before all" hook in "reporting usage"

[kibanamachine]

A test failed on a tracked branch

{ Error: [invalid_alias_name_exception] Invalid alias name [.kibana], an index exists with the same name as the alias, with { index_uuid="g8hnLncsSZWXLv6jqARTFA" & index=".kibana" }
    at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
    at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
    at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
    at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4929:19)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)
  status: 400,
  displayName: 'BadRequest',
  message:
   '[invalid_alias_name_exception] Invalid alias name [.kibana], an index exists with the same name as the alias, with { index_uuid="g8hnLncsSZWXLv6jqARTFA" & index=".kibana" }',
  path: '/.kibana_1',
  query: { include_type_name: false },
  body:
   { error:
      { root_cause: [Array],
        type: 'invalid_alias_name_exception',
        reason:
         'Invalid alias name [.kibana], an index exists with the same name as the alias',
        index_uuid: 'g8hnLncsSZWXLv6jqARTFA',
        index: '.kibana' },
     status: 400 },
  statusCode: 400,
  response:
   '{"error":{"root_cause":[{"type":"invalid_alias_name_exception","reason":"Invalid alias name [.kibana], an index exists with the same name as the alias","index_uuid":"g8hnLncsSZWXLv6jqARTFA","index":".kibana"}],"type":"invalid_alias_name_exception","reason":"Invalid alias name [.kibana], an index exists with the same name as the alias","index_uuid":"g8hnLncsSZWXLv6jqARTFA","index":".kibana"},"status":400}',
  toString: [Function],
  toJSON: [Function] }

First failure: Jenkins Build

[elasticmachine]

Pinging @elastic/kibana-test-triage (failed-test)

[spalger]

Looks like this is an instance of the issue that #71910 was intended to fix. Looking at the logs it appears that the .kibana index is being created by the bulk API, which wouldn't be cleared out by the existing "delete kibana index" logic as it targets the .kibana_n indexes. Creating a raw .kibana index indicates that the docs would be lost if we extended that method to clear out the .kibana index too, which would break tests in other ways.

I'm going to spend some time today making sure that index records are handled completely before doc records are handled... Not sure if this is a new or ancient issue... Hoping it doesn't require too much reworking of this ancient code.

[spalger]

Should be fixed by the combination of #71910 and #72354