Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing ES Promotion: composable index templates can no longer have both data stream and aliases definitions #89499

Closed
spalger opened this issue Jan 27, 2021 · 1 comment · Fixed by #89512
Labels
failed-es-promotion Feature:Fleet Fleet team's agent central management project

Comments

@spalger
Copy link
Contributor

spalger commented Jan 27, 2021

elastic/elasticsearch#67886 removed support for both data stream and aliases being defined in composable index templates. This is causing two ciGroups to fail because of fleet modules which violate this rule:

from https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/2162/execution/node/419/log/

14:04:14         └-: Fleet Endpoints
14:04:14           └-> "before all" hook
14:04:14           └-: fleet_setup
14:04:14             └-> "before all" hook
14:04:14             └-> should not create a fleet_enroll role if one does not already exist
14:04:14               └-> "before each" hook: global before each
14:04:14               └-> "before each" hook: beforeSetupWithDockerRegistry
14:04:14               └-> "before each" hook
14:04:14               │ proc [kibana]   log   [21:04:13.916] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:13.921] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:13.975] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:13.982] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:13.992] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:13.994] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:14.208] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:14               │ proc [kibana]   log   [21:04:14.250] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:04:20               │ proc [kibana]   log   [21:04:20.903] [error][fleet][plugins] uninstalling system-0.5.3 after error installing
14:04:20               │ proc [kibana]   log   [21:04:20.917] [error][fleet][plugins] failed to uninstall or rollback package after installation error Error: system is installed by default and cannot be removed
14:04:21               │ proc [kibana]   log   [21:04:21.030] [error][fleet][plugins] uninstalling endpoint-0.13.1 after error installing
14:04:21               │ proc [kibana]   log   [21:04:21.042] [error][fleet][plugins] failed to uninstall or rollback package after installation error Error: endpoint is installed by default and cannot be removed
14:04:21               │ proc [kibana]   log   [21:04:21.044] [error][fleet][plugins] [illegal_argument_exception] composable template [metrics-system.cpu] template after composition is invalid response from /_index_template/metrics-system.cpu: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"composable template [metrics-system.cpu] template after composition is invalid"}],"type":"illegal_argument_exception","reason":"composable template [metrics-system.cpu] template after composition is invalid","caused_by":{"type":"illegal_argument_exception","reason":"template [metrics-system.cpu] has alias and data stream definitions"}},"status":400}
14:04:21               └- ✖ fail: Fleet Endpoints fleet_setup should not create a fleet_enroll role if one does not already exist
14:04:21               │      Error: expected 200 "OK", got 400 "Bad Request"
14:04:21               │       at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
14:04:21               │       at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
14:04:21               │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
14:04:21               │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
14:04:21               │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
14:04:21               │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
14:04:21               │       at /dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:906:18
14:04:21               │       at IncomingMessage.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/parsers/json.js:19:7)
14:04:21               │       at endReadableNT (internal/streams/readable.js:1327:12)
14:04:21               │       at processTicksAndRejections (internal/process/task_queues.js:80:21)

from https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/2162/execution/node/395/log/

14:00:30           └-: endpoint list
14:00:30             └-> "before all" hook
14:00:30             └-: when initially navigating to page
14:00:30               └-> "before all" hook
14:00:30               └-> "before all" hook
14:00:32                 │ERROR browser[SEVERE] http://localhost:6171/internal/spaces/_active_space - Failed to load resource: the server responded with a status of 401 (Unauthorized)
14:00:32                 │ERROR browser[SEVERE] http://localhost:6171/39903/bundles/core/core.entry.js 5:3002 
14:00:32                 │ERROR browser[SEVERE] http://localhost:6171/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
14:00:32                 │ERROR browser[SEVERE] http://localhost:6171/internal/security/me - Failed to load resource: the server responded with a status of 401 (Unauthorized)
14:00:33                 │ proc [kibana]   log   [21:00:33.234] [info][plugins][routes][security] Logging in with provider "basic" (basic)
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: '6877b97f218db47a24e556ac31abb09d' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: 'dc2ca1e150652c5a29e0ce7141f1f63a' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: '70cb74f5a04351789e55ab3f185d2d55' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: '14c93d8a2c17958308fd03929eef1168' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: 'a437ad06d80a8f48d01c0215c69eb6bb' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: 'd78ced20112e370eb3c6007aa7c1ac50' }
14:00:38                 │ proc [kibana] Sending error to Elastic APM { id: '9759d04ccca61c89df632e342543ddeb' }
14:00:39                 │ proc [kibana]   log   [21:00:39.100] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:00:39                 │ proc [kibana]   log   [21:00:39.273] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:00:39                 │ proc [kibana]   log   [21:00:39.279] [info][fleet][plugins] Custom registry url is an experimental feature and is unsupported.
14:00:39                 │ proc [kibana] Sending error to Elastic APM { id: '5fe9ed82d619e4af9a64653dac0ded8b' }
14:00:39                 │ proc [kibana] Sending error to Elastic APM { id: '11064d51cfb7b2fb55ac34ef4859fe6b' }
14:00:40                 │ERROR browser[SEVERE] http://localhost:6171/api/detection_engine/index - Failed to load resource: the server responded with a status of 404 (Not Found)
14:00:40                 │ERROR browser[SEVERE] http://localhost:6171/api/detection_engine/index - Failed to load resource: the server responded with a status of 404 (Not Found)
14:00:40               └-> finds no data in list and prompts onboarding to add policy
14:00:40                 └-> "before each" hook: global before each
14:00:40                 └- ✓ pass  (37ms) "endpoint endpoint list when initially navigating to page finds no data in list and prompts onboarding to add policy"
14:00:40               └-> finds data after load and polling
14:00:40                 └-> "before each" hook: global before each
14:00:48                 │ proc [kibana] APM Server transport error (ECONNRESET): socket hang up
14:00:55                 └- ✖ fail: endpoint endpoint list when initially navigating to page finds data after load and polling
14:00:55                 │      Error: timed out waiting for table to have data -- last error: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="endpointListTable"])
14:00:55                 │ Wait timed out after 10008ms
14:00:55                 │     at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
14:00:55                 │     at processTicksAndRejections (internal/process/task_queues.js:93:5)
14:00:55                 │       at onFailure (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_truthy.ts:39:13)
14:00:55                 │       at retryForSuccess (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:57:13)
14:00:55                 │       at retryForTruthy (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_truthy.ts:27:3)
14:00:55                 │       at Retry.waitForWithTimeout (/dev/shm/workspace/kibana/test/common/services/retry/retry.ts:46:7)
14:00:55                 │       at Object.waitForTableToHaveData (test/security_solution_endpoint/page_objects/endpoint_page.ts:28:7)
14:00:55                 │       at Context.<anonymous> (test/security_solution_endpoint/apps/endpoint/endpoint_list.ts:88:9)
14:00:55                 │       at Object.apply (/dev/shm/workspace/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-es-promotion Feature:Fleet Fleet team's agent central management project
Projects
None yet
2 participants