Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v23.3.x] Respect target local retention settings when moving cloud enabled partition replicas #19835

Conversation

mmaslankaprv
Copy link
Member

Backport of PR #19820

@mmaslankaprv mmaslankaprv added this to the v23.3.x-next milestone Jun 13, 2024
@mmaslankaprv mmaslankaprv added the kind/backport PRs targeting a stable branch label Jun 13, 2024
@mmaslankaprv mmaslankaprv marked this pull request as ready for review June 13, 2024 06:22
@mmaslankaprv mmaslankaprv modified the milestones: v23.3.x-next, v23.3.17 Jun 13, 2024
With non strict local retention the storage manager will not trigger
data eviction immediately when partition is eligible for eviction but
will allow local data to use the whole available disk space. Using
standard partition movement policy would force raft to deliver all local
data over the network which is not necessary and might take long time.

Changed the controller backend to always override the learner start
offset when non strict retention is enabled and deliver over the network
only data that would normally be retained if strict local retention is
turned on.

Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit bf97be3)
Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit 4d56cfe)
@mmaslankaprv mmaslankaprv force-pushed the vbotbuildovich/backport-19820-v23.3.x-72 branch from a6de600 to 32d6b97 Compare June 13, 2024 07:12
@mmaslankaprv mmaslankaprv requested a review from ztlpn June 13, 2024 08:03
@mmaslankaprv
Copy link
Member Author

the error is unrelated but relevant. i will chase that further.

@mmaslankaprv mmaslankaprv merged commit b71b6a5 into redpanda-data:v23.3.x Jun 13, 2024
14 of 17 checks passed
@mmaslankaprv mmaslankaprv deleted the vbotbuildovich/backport-19820-v23.3.x-72 branch June 13, 2024 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda kind/backport PRs targeting a stable branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants