Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.x] [FTR][CI] Use default distribution for all tests (#94968) #101319

Closed
wants to merge 3 commits into from

Conversation

tylersmalley
Copy link
Contributor

@tylersmalley tylersmalley commented Jun 3, 2021

Backports the following commits to 7.x:

@tylersmalley tylersmalley changed the title [FTR][CI] Use default distribution for all tests (#94968) [7.x] [FTR][CI] Use default distribution for all tests (#94968) Jun 3, 2021
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
Tyler Smalley added 2 commits June 8, 2021 13:28
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
@kibanamachine
Copy link
Contributor

kibanamachine commented Jun 8, 2021

💔 Build Failed

Failed CI Steps


Test Failures

Kibana Pipeline / general / Chrome UI Functional Tests.test/functional/apps/management/_test_huge_fields·js.management test large number of fields "before all" hook for "test_huge data should have expected number of fields"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 7 times on tracked branches: https://github.com/elastic/kibana/issues/89031

[00:00:00]       │
[00:00:00]         └-: management
[00:00:00]           └-> "before all" hook in "management"
[00:00:00]           └-> "before all" hook in "management"
[00:00:00]             │ info [logstash_functional] Unloading indices from "mappings.json"
[00:00:00]             │ info [logstash_functional] Unloading indices from "data.json.gz"
[00:00:01]             │ info [makelogs] Loading "mappings.json"
[00:00:01]             │ info [makelogs] Loading "data.json.gz"
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] [logstash-2015.09.17] creating index, cause [api], templates [], shards [1]/[0]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.17][0]]]).
[00:00:01]             │ info [makelogs] Created index "logstash-2015.09.17"
[00:00:01]             │ debg [makelogs] "logstash-2015.09.17" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] [logstash-2015.09.18] creating index, cause [api], templates [], shards [1]/[0]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.18][0]]]).
[00:00:01]             │ info [makelogs] Created index "logstash-2015.09.18"
[00:00:01]             │ debg [makelogs] "logstash-2015.09.18" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:01]             │ info [makelogs] Indexed 101 docs into "logstash-2015.09.17"
[00:00:01]             │ info [makelogs] Indexed 301 docs into "logstash-2015.09.18"
[00:00:02]           └-: 
[00:00:02]             └-> "before all" hook in ""
[00:11:58]             └-: test large number of fields
[00:11:58]               └-> "before all" hook for "test_huge data should have expected number of fields"
[00:11:58]               └-> "before all" hook for "test_huge data should have expected number of fields"
[00:11:58]                 │ warn delete by query deleted 0 of 8 total documents, trying again
[00:11:58]                 │ warn delete by query deleted 0 of 8 total documents, trying again
[00:11:58]                 │ warn since spaces are enabled, all objects other than the default space were deleted from .kibana rather than deleting the whole index
[00:11:58]                 │ info [emptyKibanaIndex] Deleted existing index ".kibana"
[00:11:58]                 │ debg Migrating saved objects
[00:11:58]                 │ proc [kibana]   log   [21:29:52.073] [info][savedobjects-service] [.kibana_task_manager] INIT -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 2ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.076] [info][savedobjects-service] [.kibana] INIT -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 7ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.078] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 6ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.081] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 5ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.083] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 5ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.085] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> UPDATE_TARGET_MAPPINGS. took: 2ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.087] [info][savedobjects-service] [.kibana] Starting to process 1 documents.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.087] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_TRANSFORM. took: 6ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.088] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_TRANSFORM -> TRANSFORMED_DOCUMENTS_BULK_INDEX. took: 1ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.094] [info][savedobjects-service] [.kibana_task_manager] UPDATE_TARGET_MAPPINGS -> UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK. took: 9ms.
[00:11:58]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] 11605 finished with response BulkByScrollResponse[took=1.3ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:11:58]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] [.kibana_7.14.0_001/zQSBFrISTLmAOfAXEJQO8Q] update_mapping [_doc]
[00:11:58]                 │ proc [kibana]   log   [21:29:52.131] [info][savedobjects-service] [.kibana] TRANSFORMED_DOCUMENTS_BULK_INDEX -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 43ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.136] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 5ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.140] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> OUTDATED_DOCUMENTS_REFRESH. took: 4ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.153] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_REFRESH -> UPDATE_TARGET_MAPPINGS. took: 13ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.193] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS -> UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK. took: 40ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.197] [info][savedobjects-service] [.kibana_task_manager] UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK -> DONE. took: 103ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.197] [info][savedobjects-service] [.kibana_task_manager] Migration completed after 127ms
[00:11:58]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] 11629 finished with response BulkByScrollResponse[took=13.8ms,timed_out=false,sliceId=null,updated=1,created=0,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:11:58]                 │ proc [kibana]   log   [21:29:52.296] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK -> DONE. took: 103ms.
[00:11:58]                 │ proc [kibana]   log   [21:29:52.298] [info][savedobjects-service] [.kibana] Migration completed after 229ms
[00:11:58]                 │ info [emptyKibanaIndex] Created index ".kibana"
[00:11:58]                 │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC","visualization:visualize:legacyChartsLibrary":true}
[00:12:00]                 │ info [large_fields] Loading "mappings.json"
[00:12:00]                 │ info [large_fields] Loading "data.json.gz"
[00:12:00]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] [testhuge] creating index, cause [api], templates [], shards [5]/[1]
[00:12:00]                 │ info [large_fields] Created index "testhuge"
[00:12:00]                 │ debg [large_fields] "testhuge" settings {"index":{"mapping":{"total_fields":{"limit":"50000"}},"number_of_replicas":"1","number_of_shards":"5"}}
[00:12:01]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] [testhuge/a07NbmEITaCLOTqCgjnreg] update_mapping [_doc]
[00:12:01]                 │ info [large_fields] Indexed 1 docs into "testhuge"
[00:12:01]                 │ info [o.e.i.b.HierarchyCircuitBreakerService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] attempting to trigger G1GC due to high heap usage [1022243328]
[00:12:01]                 │ info [o.e.i.b.HierarchyCircuitBreakerService] [kibana-ci-immutable-centos-tests-xxl-1623184178367857239] GC did not bring memory usage down, before [1022243328], after [1035978336], allocations [10], duration [13]
[00:12:01]                 │ info Taking screenshot "/dev/shm/workspace/parallel/23/kibana/test/functional/screenshots/failure/management  test large number of fields _before all_ hook for _test_huge data should have expected number of fields_.png"
[00:12:01]                 │ info Current URL is: http://localhost:61231/app/management/kibana/objects
[00:12:01]                 │ info Saving page source to: /dev/shm/workspace/parallel/23/kibana/test/functional/failure_debug/html/management  test large number of fields _before all_ hook for _test_huge data should have expected number of fields_.html
[00:12:01]                 └- ✖ fail: management  test large number of fields "before all" hook for "test_huge data should have expected number of fields"
[00:12:01]                 │      ResponseError: circuit_breaking_exception: [circuit_breaking_exception] Reason: [parent] Data too large, data for [<http_request>] would be [1022243328/974.8mb], which is larger than the limit of [1020054732/972.7mb], real usage: [1022243328/974.8mb], new bytes reserved: [0/0b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=0/0b, model_inference=0/0b, accounting=88176/86.1kb]
[00:12:01]                 │       at onBody (node_modules/@elastic/elasticsearch/lib/Transport.js:337:23)
[00:12:01]                 │       at IncomingMessage.onEnd (node_modules/@elastic/elasticsearch/lib/Transport.js:264:11)
[00:12:01]                 │       at endReadableNT (internal/streams/readable.js:1336:12)
[00:12:01]                 │       at processTicksAndRejections (internal/process/task_queues.js:82:21)
[00:12:01]                 │ 
[00:12:01]                 │ 

Stack Trace

ResponseError: circuit_breaking_exception: [circuit_breaking_exception] Reason: [parent] Data too large, data for [<http_request>] would be [1022243328/974.8mb], which is larger than the limit of [1020054732/972.7mb], real usage: [1022243328/974.8mb], new bytes reserved: [0/0b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=0/0b, model_inference=0/0b, accounting=88176/86.1kb]
    at onBody (node_modules/@elastic/elasticsearch/lib/Transport.js:337:23)
    at IncomingMessage.onEnd (node_modules/@elastic/elasticsearch/lib/Transport.js:264:11)
    at endReadableNT (internal/streams/readable.js:1336:12)
    at processTicksAndRejections (internal/process/task_queues.js:82:21) {
  meta: {
    body: { error: [Object], status: 429 },
    statusCode: 429,
    headers: {
      'content-type': 'application/json; charset=UTF-8',
      'content-length': '907'
    },
    meta: {
      context: null,
      request: [Object],
      name: 'elasticsearch-js',
      connection: [Object],
      attempts: 0,
      aborted: false
    }
  }
}

Metrics [docs]

✅ unchanged

History

  • 💔 Build #129940 failed 23bed9d420580c173ba9f0ec9c38b4e1bf6f3445
  • 💚 Build #129667 succeeded 95f711710a99a85cd1d2996419eccb1bd464a7ab
  • 💔 Build #129653 failed e14f3c9cc1aeff04eeb5227643c61056466523fa
  • 💔 Build #129011 failed fe5dcf42cf9e887f8af0fb4e8f835401fb4a3c21

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants