Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BP-65: Implement load balance for select bookie #4246

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

TakaHiR07
Copy link
Contributor

@TakaHiR07 TakaHiR07 commented Mar 27, 2024

Motivation

Implement bookie load balance to avoid bookie high write latency problem.

Master issue: #4247

Changes

The proposed changes involves:

  1. Implement BaseMetricMonitor in bookie server, which would collect bookie load information periodically
  2. bookie client continue to use getBookieInfo restApi to acquire load information from each bookie.
  3. modify the implementation of RackawareEnsemblePlacementPolicyImpl, support select ensemble by LoadWeightBasedPlacement. Since LoadWeightBasedPlacement is an enhancement of DiskWeightBasedPlacement, it would cover the DiskWeightBasedPlacement if feature enable.

If this PR is a BookKeeper Proposal (BP):

  • Make sure the PR title is formatted like:
    <BP-#>: Description of bookkeeper proposal
    e.g. BP-1: 64 bits ledger is support
  • Attach the master issue link in the description of this PR.
  • Attach the google doc link if the BP is written in Google Doc.

optional int32 journalIoUtil = 4;
optional int32 ledgerIoUtil = 5;
optional int32 cpuUsedRate = 6;
optional int64 writeBytePerSecond = 7;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shall we name it writeBytesPerSecond?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants