Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

63 enhancement reduce overall memory consumption and improve read speed #64

Merged
merged 11 commits into from
Jul 19, 2024
Merged

63 enhancement reduce overall memory consumption and improve read speed #64

merged 11 commits into from
Jul 19, 2024

Commits on Jul 19, 2024

  1. Use deserialization with code generation for dotnet 6.0 and above. 

    (cherry picked from commit f69dc36)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    39d512f View commit details
    Browse the repository at this point in the history

  2. Upgrade dependencies. 

    (cherry picked from commit d05b21d)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    766c6b9 View commit details
    Browse the repository at this point in the history

  3. Add get parts count method. 

    (cherry picked from commit 26888da)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    9a4d630 View commit details
    Browse the repository at this point in the history

  4. Fix naming of maintainer cleanup job. 

    (cherry picked from commit 28f19a1)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    33450c4 View commit details
    Browse the repository at this point in the history

  5. Add circular cache for keys on disk segments. 

    (cherry picked from commit 03a7c060996ca4485d948f95a7b42c47e6afa991)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    33242a6 View commit details
    Browse the repository at this point in the history

  6. Upgrade byte[] arrays into Memory<byte> 

    (cherry picked from commit f8b42a712f9e6e90309966391fde911351b2a55f)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    da6adad View commit details
    Browse the repository at this point in the history

  7. Create and persist default sparse array on disk segment creation. 

    (cherry picked from commit f75bc0a231dcf67751d2d88fed9d55f46c5a40e6)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    40d627a View commit details
    Browse the repository at this point in the history

  8. Add circular value cache per disk segment. 

    (cherry picked from commit a0f1862744ba092ad3e1b0d8fb52ac60d5e175d4)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    5f9f45c View commit details
    Browse the repository at this point in the history

  9. Use ArrayPool for compressedBlocks. 

    (cherry picked from commit c8150aed1782b4b6110b5254f5da02d5af11df2d)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    04646e6 View commit details
    Browse the repository at this point in the history

  10. Replace the circular block cache with hashtable for faster and stable… 

    … reads.

(cherry picked from commit 47287b25591313b0c1fba0e6e801c66f74dbf56a)
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    1fd3881 View commit details
    Browse the repository at this point in the history

  11. Pin iterators to the compression block cache to reduce memory consump… 

    …tion.
    @koculu
    koculu committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    91cc5d6 View commit details
    Browse the repository at this point in the history