Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

c/p_balancer: fixed possible overflow of final used ration #19794

Merged
merged 1 commit into from
Jun 12, 2024

Conversation

mmaslankaprv
Copy link
Member

@mmaslankaprv mmaslankaprv commented Jun 12, 2024

Replicas eviction policy is asynchronously applied to each partition it may happen that the size of individual partitions is not exactly equal to the total usage size reported. In this case the individual partition sizes that are moved out of the node may sum up to a value larger than the total used bytes. Added a code preventing overflowing the final ratio in this case

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v24.1.x
  • v23.3.x
  • v23.2.x

Release Notes

Bug Fixes

  • fixed overflow that may lead to unnecessary moves

Replicas eviction policy is asynchronously applied to each partition it
may happen that the size of individual partitions is not exactly equal
to the total usage size reported. In this case the individual partition
sizes that are moved out of the node may sum up to a value larger than
the total used bytes. Added a code preventing overflowing the final
ratio in this case

Signed-off-by: Michał Maślanka <michal@redpanda.com>
@mmaslankaprv mmaslankaprv force-pushed the fix-overflow-balancer branch from f170a68 to ba31bfb Compare June 12, 2024 08:39
@vbotbuildovich
Copy link
Collaborator

new failures in https://buildkite.com/redpanda/redpanda/builds/50155#01900bc6-9866-44a9-a7ab-8c276ecf4b3d:

"rptest.tests.e2e_shadow_indexing_test.EndToEndThrottlingTest.test_throttling.cloud_storage_type=CloudStorageType.ABS"

@mmaslankaprv
Copy link
Member Author

ci failure: #14139

@mmaslankaprv mmaslankaprv merged commit fc05cc0 into redpanda-data:dev Jun 12, 2024
15 of 18 checks passed
@vbotbuildovich
Copy link
Collaborator

/backport v24.1.x

@vbotbuildovich
Copy link
Collaborator

/backport v23.3.x

@vbotbuildovich
Copy link
Collaborator

/backport v23.2.x

@ztlpn
Copy link
Contributor

ztlpn commented Jun 12, 2024

/backport v24.1.x

@ztlpn
Copy link
Contributor

ztlpn commented Jun 12, 2024

/backport v23.3.x

@ztlpn
Copy link
Contributor

ztlpn commented Jun 12, 2024

/backport v23.2.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants