Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed setting up consumer for interruption test #11484

Merged
merged 1 commit into from
Jun 16, 2023

Conversation

mmaslankaprv
Copy link
Member

Previously the producer used high throughput which may lead to the situation in which consumer continued without a gap in the offset space even after the topic was deleted.
The producer might have already produced enough records to fill the gap and allow consumer to continue where it left of.

Using lower producer throughput and waiting for large number of records to be consumed before deleting topic will prevent this situation from happening.

Fixes: #11459

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.1.x
  • v22.3.x
  • v22.2.x

Release Notes

  • none

Previously the producer used high throughput which may lead to the
situation in which consumer continued without a gap in the offset space
even after the topic was deleted.
The producer might have already produced enough records to fill the gap
and allow consumer to continue where it left of.

Using lower producer throughput and waiting for large number of records
to be consumed before deleting topic will prevent this situation from
happening.

Fixes: redpanda-data#11459

Signed-off-by: Michal Maslanka <michal@redpanda.com>
@mmaslankaprv mmaslankaprv merged commit 4f9dde9 into redpanda-data:dev Jun 16, 2023
@mmaslankaprv mmaslankaprv deleted the fix-11459 branch June 16, 2023 14:24
mmaslankaprv added a commit that referenced this pull request Jul 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CI Failure (Consumer failed to consume up to offsets) in SimpleEndToEndTest.test_consumer_interruption
2 participants