Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make mget task claim strategy poll more frequently #190059

Merged
merged 8 commits into from
Aug 9, 2024

Conversation

mikecote
Copy link
Contributor

@mikecote mikecote commented Aug 7, 2024

In this PR, I'm changing the default poll_interval to 500 whenever mget claim strategy is set. This keeps the 3000 value for the default task claiming strategy and setting xpack.task_manager.poll_interval still takes precedence.

I'm increasing the frequency because we no longer get as much contention when adding Kibana nodes, allowing tasks to be picked up more frequently / on-time.

To verify

  1. Add a console log to the task manager plugin constructor (like 1e6b1ac)
  2. Startup this PR without any task manager yml settings
  3. Observe 3000 is the poll interval
  4. Set xpack.task_manager.claim_strategy: 'unsafe_mget' in the kibana.yml file and wait for Kibana restart
  5. Observe 500 is the poll interval
  6. Set xpack.task_manager.poll_interval: 3001 and wait for Kibana restart
  7. Observe 3001 is the poll interval
  8. Remove xpack.task_manager.claim_strategy setting and wait for Kibana restart
  9. Observe 3001 is still poll interval
  10. Remove xpack.task_manager.poll_interval setting

Flaky test runner for mget tests: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6722

@mikecote mikecote added Feature:Task Manager Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) labels Aug 7, 2024
@mikecote
Copy link
Contributor Author

mikecote commented Aug 7, 2024

/ci

@mikecote
Copy link
Contributor Author

mikecote commented Aug 7, 2024

@elasticmachine merge upstream

@mikecote
Copy link
Contributor Author

mikecote commented Aug 7, 2024

/ci

@mikecote mikecote self-assigned this Aug 7, 2024
@mikecote
Copy link
Contributor Author

mikecote commented Aug 7, 2024

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6710

[❌] x-pack/test/task_manager_claimer_mget/config.ts: 0/100 tests passed.

see run history

@mikecote
Copy link
Contributor Author

mikecote commented Aug 8, 2024

@elasticmachine merge upstream

@mikecote
Copy link
Contributor Author

mikecote commented Aug 8, 2024

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6720

[❌] x-pack/test/task_manager_claimer_mget/config.ts: 47/100 tests passed.

see run history

@mikecote
Copy link
Contributor Author

mikecote commented Aug 8, 2024

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6722

[✅] x-pack/test/task_manager_claimer_mget/config.ts: 100/100 tests passed.

see run history

@mikecote mikecote marked this pull request as ready for review August 8, 2024 15:58
@mikecote mikecote requested a review from a team as a code owner August 8, 2024 15:58
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @mikecote

@mikecote mikecote added release_note:skip Skip the PR/issue when compiling release notes v8.16.0 labels Aug 9, 2024
Copy link
Contributor

@ersin-erdal ersin-erdal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM,
Tested locally, works as expected

@mikecote mikecote merged commit 0f42e78 into elastic:main Aug 9, 2024
39 checks passed
@kibanamachine kibanamachine added the backport:skip This commit does not require backporting label Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting Feature:Task Manager release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) v8.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants