Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bpo-37448: Add radix tree implementation for obmalloc address_in_range(). #14474

Merged
merged 17 commits into from
Mar 30, 2021
Merged

bpo-37448: Add radix tree implementation for obmalloc address_in_range(). #14474

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
4d0a006
Add radix tree implementation for obmalloc address_in_range().
nascheme Jun 29, 2019
295ad0b
Add News entry.
nascheme Jun 29, 2019
e6e100b
Improve comment about size of ARENA_BITS.
nascheme Jun 30, 2019
c96c215
handle overflow of arena_base_next
nascheme Jul 1, 2019
e2d9541
change arena_next overflow check to an assert
nascheme Jul 3, 2019
d7361d6
Exploit current hardware physical address bits
nascheme Jul 3, 2019
3492ef6
Remove if, assert() is sufficient.
nascheme Jul 4, 2019
9b2886f
wip: 32-bit version
nascheme Feb 20, 2021
2e025b0
wip: re-org code
nascheme Feb 20, 2021
21c1679
wip: code cleanup, renames, comments
nascheme Feb 21, 2021
c696d20
wip: increase pool and arena sizes by 4x
nascheme Feb 21, 2021
4df4225
Update blurb entry.
nascheme Feb 21, 2021
94ad760
Use smaller pool and arena sizes for 32-bit.
nascheme Feb 22, 2021
509a5c7
Add USE_RADIX_TREE flag.
nascheme Feb 24, 2021
130a7ed
Rename preprocessor flag, make easy to override.
nascheme Feb 25, 2021
e0924e6
Minor improvements to names and comments.
nascheme Mar 3, 2021
b41a77a
Improve sys._debugmallocstats() output.
nascheme Mar 6, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions Misc/NEWS.d/next/Core and Builtins/2021-02-21-14-19-35.bpo-37448.btl7vO.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
Add a radix tree based memory map to track in-use obmalloc arenas. Use to
replace the old implementation of address_in_range(). The radix tree
approach makes it easy to increase pool sizes beyond the OS page size.
Boosting the pool and arena size allows obmalloc to handle a significantly
higher percentage of requests from its ultra-fast paths.

It also has the advantage of eliminating the memory unsanitary behavior of
the previous address_in_range(). The old address_in_range() was marked with
the annotations _Py_NO_SANITIZE_ADDRESS, _Py_NO_SANITIZE_THREAD, and
_Py_NO_SANITIZE_MEMORY. Those annotations are no longer needed.

To disable the radix tree map, set a preprocessor flag as follows:
`-DWITH_PYMALLOC_RADIX_TREE=0`.

Co-authored-by: Tim Peters <tim.peters@gmail.com>
Loading