Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

archival/tests: yield more often to the scheduler #18411

Merged
merged 1 commit into from
May 13, 2024

Conversation

nvartolomei
Copy link
Contributor

@nvartolomei nvartolomei commented May 11, 2024

Adding a segment takes ~1ms. Adding multiple segments in a single batch
can stall the reactor for a while. This, together with a recent seastar
change1 caused some timeouts to fire very frequently2.

Fix the problematic test by splitting the batch passed to add_segments
so that we execute more finer grained tasks and yield more often to the
scheduler.

Fixes #13275

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v24.1.x
  • v23.3.x
  • v23.2.x

Release Notes

  • none

Footnotes

  1. https://github.com/scylladb/seastar/issues/2238

  2. https://github.com/redpanda-data/redpanda/issues/13275

Adding a segment takes ~1ms. Adding multiple segments in a single batch
can stall the reactor for a while. This, together with a recent seastar
change[^1] caused some timeouts to fire very frequently[^2].

Fix the problematic test by splitting the batch passed to add_segments
so that we execute more finer grained tasks and yield more often to the
scheduler.

[^1]: scylladb/seastar#2238
[^2]: redpanda-data#13275
@nvartolomei nvartolomei force-pushed the nv/archiver-timeout-fix branch from 8ac19b7 to 545a04f Compare May 13, 2024 08:32
@nvartolomei nvartolomei merged commit deb7fb0 into redpanda-data:dev May 13, 2024
19 checks passed
@nvartolomei nvartolomei deleted the nv/archiver-timeout-fix branch May 13, 2024 11:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants