Skip to content
This repository has been archived by the owner on Mar 8, 2024. It is now read-only.

Profile low level (OS) memory allocation #78

Closed
pjenvey opened this issue Dec 19, 2017 · 1 comment
Closed

Profile low level (OS) memory allocation #78

pjenvey opened this issue Dec 19, 2017 · 1 comment
Assignees

Comments

@pjenvey
Copy link
Member

pjenvey commented Dec 19, 2017

Under load testing scenarios for #76 we're seeing a significantly higher RSS size for autopush/endpoint processes vs the amount of memory allocated by PyPy.

PyPy's total allocated memory size has been confirmed via introspecting data structures in gdb and also via initial versions of PyPy's new mem stats API per [Q4 OKR 2.1](mozilla-services/push-okr#52

The only other significant allocations seen under massif profiling are from OpenSSL. It should however have reasonable memory usage after fixing autopush#1038.

We need extra memory statistics about the OS level malloc, because we don't seem to be 100% responsible for our memory leak.

PyPy GC's may cause some fragmentation over time but we're seeing way too much leakage/memory usage.

@pjenvey
Copy link
Member Author

pjenvey commented Dec 19, 2017

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants