Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Memory Leak #132

Closed
hleb-albau opened this issue Dec 26, 2018 · 6 comments
Closed

Memory Leak #132

hleb-albau opened this issue Dec 26, 2018 · 6 comments
Assignees
@cyborgshead
Labels
Code: Performance Priority: Critical Status: Completed Type: Bug Something isn't working

Comments

@hleb-albau
Copy link
Contributor

Some validators complaining about OOM error.
Also, earth grabs about 60gb RAM by 3-4 days, but after restart only 1gb.
@hleb-albau
Copy link
Contributor Author

image

@cyborgshead cyborgshead self-assigned this Jul 24, 2019
@cyborgshead cyborgshead changed the title Possible Memory Leak Memory Leak Nov 3, 2020
@mrlp4
Copy link
Member

mrlp4 commented Nov 29, 2020 •
edited
Loading

Issue update: memory leaks 25gb per 10h.
Cpu profiler logs
cpu_prof_mars.log
Screen Shot 2020-11-29 at 9 18 09 AM

@cyborgshead
Copy link
Member

cyborgshead commented Dec 2, 2020 •
edited
Loading

Wherever there is C code, first of all, you need to look at memory leaks in it
There were 3 mallocs which were not freed
During each calculation window non-freed memory increases
Because we have very close to 1 million CIDs and agents are triggering rank calculation each cycle this follow to so critical memory leak

@cyborgshead cyborgshead mentioned this issue Dec 2, 2020
Merged
@cyborgshead
Copy link
Member

@mrlp4 please provide small-guide for validators how to upgrade for Euler-6.4

@cyborgshead
Copy link
Member

Screen Shot 2020-12-03 at 10 55 26

@hleb-albau I'm very happy that fix this. Next going to deal with this spike which goes when chain loads rank context and last context

@cyborgshead
Copy link
Member

Done in Bostrom

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cyborgshead cyborgshead

Labels
Code: Performance Priority: Critical Status: Completed Type: Bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@cyborgshead @hleb-albau @mrlp4