Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using chunked_fifo in heartbeat_manager #10915

Merged
merged 2 commits into from
May 25, 2023

Conversation

mmaslankaprv
Copy link
Member

@mmaslankaprv mmaslankaprv commented May 22, 2023

Using ss::chunked_fifo in heartbeats manager when collecting node heartbeat requests.

Fixes: #10751

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.1.x
  • v22.3.x
  • v22.2.x

Release Notes

  • none

Using `chunked_fifo` allows to reduce large allocations in heartbeat
manager.

Fixes: redpanda-data#10751

Signed-off-by: Michal Maslanka <michal@redpanda.com>
Signed-off-by: Michal Maslanka <michal@redpanda.com>
Comment on lines -276 to +278
absl::btree_map<raft::group_id, follower_request_meta> groups,
const absl::node_hash_map<raft::group_id, follower_request_meta>& groups,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whats this change for?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i just wanted to accommodate to what we agreed previously in slack that the node_hash_map is better suited in the cases when we do not need ordering as it provides enough prevention from memory fragmentation.

Copy link
Contributor

@bharathv bharathv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm.

@mmaslankaprv
Copy link
Member Author

ci failure: #10497

@mmaslankaprv mmaslankaprv merged commit 2fa1152 into redpanda-data:dev May 25, 2023
@mmaslankaprv mmaslankaprv deleted the fix-10751 branch May 25, 2023 05:34
@vbotbuildovich
Copy link
Collaborator

/backport v23.1.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Oversized allocation: 491520 bytes in raft::heartbeat_manager::do_dispatch_heartbeats
4 participants