Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloud_storage/ducktape: Adjust test for cache size smaller than segment #11773

Conversation

abhijat
Copy link
Contributor

@abhijat abhijat commented Jun 29, 2023

The test where cache size is smaller than segment size is adjusted to use a low chunk size to reduce trim frequency. Additionally the count of messages read back by consumer is reduced to read a couple of full segments and not the entire range of messages produced.

FIXES #11449

Does not fix the variant of #11449 where the client makes no progress, but that is tracked separately as a kgo issue

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.1.x
  • v22.3.x
  • v22.2.x

Release Notes

  • none

@abhijat abhijat force-pushed the issues/11449/cache-size-smaller-than-segment-test branch from c535767 to b0ad535 Compare June 29, 2023 08:54
@abhijat
Copy link
Contributor Author

abhijat commented Jun 29, 2023

/ci-repeat 10
skip-units
dt-repeat=100
tests/rptest/tests/cloud_storage_chunk_read_path_test.py::CloudStorageChunkReadTest.test_read_when_cache_smaller_than_segment_size

abhijat added 2 commits June 29, 2023 14:45
The test which simulates a cache smaller than the segment size may
suffer from timeout failures due to throttling of cache trim. To address
this the chunk size is made smaller to reduce trimming frequency, and we
read fewer messages in the consumer, just enough that the chunk read
path is exercised.
@abhijat abhijat force-pushed the issues/11449/cache-size-smaller-than-segment-test branch from b0ad535 to 6277f16 Compare June 29, 2023 09:15
@abhijat
Copy link
Contributor Author

abhijat commented Jun 29, 2023

/ci-repeat 10
skip-units
dt-repeat=100
tests/rptest/tests/cloud_storage_chunk_read_path_test.py::CloudStorageChunkReadTest.test_read_when_cache_smaller_than_segment_size

@abhijat abhijat marked this pull request as ready for review June 29, 2023 11:47
@abhijat abhijat requested review from VladLazar and andrwng June 29, 2023 11:47
@abhijat abhijat merged commit 43ae692 into redpanda-data:dev Jun 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants