Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pb/planner: switch _ntp2size to absl::btree_map #11740

Merged
merged 1 commit into from
Jun 28, 2023

Conversation

bharathv
Copy link
Contributor

This particular map can get large-ish with lots of partitions. Switch to btree_map as this is not a hot-path.

Fixes #11677

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.1.x
  • v22.3.x
  • v22.2.x

Release Notes

  • none

This particular map can get large-ish with lots of partitions. Switch
to btree_map as this is not a hot-path.
Copy link
Contributor

@ztlpn ztlpn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not a hot-path.

Actually IIRC operations with this map amount to a sizable chunk of planning runtime (we can check with bench tests). Anyway, we can correct any performance hit from switching to btree_map by using some integer (such as raft group id) as a key for this map :)

@bharathv
Copy link
Contributor Author

Failures (unrelated).

@vshtokman vshtokman merged commit 713e7be into redpanda-data:dev Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Oversized allocation: 299008 bytes in container_internal::raw_hash_set
3 participants