work in progress: Mem cache and dependency res. improvements etc. #9334
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
bep
force-pushed
the
new-key-structure
branch
4 times, most recently
from
d5a3148
to
2406e8d
Compare
TODO(bep) improve commit message. Hugo has always been a active user of in-memory caches, but before this commit we did nothing to control the memory usage. One failing example would be loading lots of big JSON data files and unmarshal them via `transform.Unmarshal`. This commit consolidates all these caches into one single LRU cache with an eviction strategy that also considers used vs. available memory. Hugo will try to limit its memory usage to 1/4 or total system memory, but this can be controlled with the `HUGO_MEMORYLIMIT` environment variable (a float value representing Gigabytes). A natural next step after this would be to use this cache for `.Content`. Fixes gohugoio#8307 Fixes gohugoio#8498 Fixes gohugoio#8927 Fixes gohugoio#9192 Fixes gohugoio#9189 Fixes gohugoio#7425 Fixes gohugoio#7437 Fixes gohugoio#7436 Fixes gohugoio#7882 Updates gohugoio#7544 Fixes gohugoio#9224 Fixes gohugoio#9324 Fixes gohugoio#9352 Fixes gohugoio#9355 Fixes gohugoio#9343
|
I'll reopen this a little later. |
|
This pull request has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
TODO(bep) improve commit message.
Hugo has always been a active user of in-memory caches, but before this commit we did nothing to control the memory usage.
One failing example would be loading lots of big JSON data files and unmarshal them via
transform.Unmarshal.This commit consolidates all these caches into one single LRU cache with an eviction strategy that also considers used vs. available memory.
Hugo will try to limit its memory usage to 1/4 or total system memory, but this can be controlled with the
HUGO_MEMORYLIMITenvironment variable (a float value representing Gigabytes).A natural next step after this would be to use this cache for
.Content.Fixes #8307
Fixes #8498
Fixes #8927
Fixes #9192
Fixes #9189
Fixes #7425
Fixes #7437
Fixes #7436
Fixes #7882
Updates #7544
Fixes #9224
Fixes #9324