Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support WAL Compression #12476

Merged
merged 32 commits into from
Jun 18, 2024
Merged

Support WAL Compression #12476

merged 32 commits into from
Jun 18, 2024

Commits on Jun 17, 2024

  1. enable wal compression 

    remove metrics in mem table flush task, cache hash code in partial path, use gzip to compress wal

batch update metrics
    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8c52f5c View commit details
    Browse the repository at this point in the history

  2. fix bug

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    693ffb7 View commit details
    Browse the repository at this point in the history

  3. fix compilation problem

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e2e6bc1 View commit details
    Browse the repository at this point in the history

  4. remove useless code

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    896a357 View commit details
    Browse the repository at this point in the history

  5. recover some code

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ee3a64f View commit details
    Browse the repository at this point in the history

  6. support compression type in WAL Compress Header

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1316653 View commit details
    Browse the repository at this point in the history

  7. support multi version WAL

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2728057 View commit details
    Browse the repository at this point in the history

  8. edit configuration item

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e70df23 View commit details
    Browse the repository at this point in the history

  9. add log for WAL size

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2db27b1 View commit details
    Browse the repository at this point in the history

  10. temp for debug

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b505d31 View commit details
    Browse the repository at this point in the history

  11. fix bug

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    95c0fd5 View commit details
    Browse the repository at this point in the history

  12. remove useless log

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    23d1743 View commit details
    Browse the repository at this point in the history

  13. remove one configuration

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8bedc72 View commit details
    Browse the repository at this point in the history

  14. use compression rate to update wal disk usage

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    69ebc89 View commit details
    Browse the repository at this point in the history

  15. fix ut

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d6ca95b View commit details
    Browse the repository at this point in the history

  16. fix test

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4373559 View commit details
    Browse the repository at this point in the history

  17. set default to uncompress

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    27a15c3 View commit details
    Browse the repository at this point in the history

  18. fix wal ut

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cd8939f View commit details
    Browse the repository at this point in the history

  19. optimize calculating of wal size

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    610a2e2 View commit details
    Browse the repository at this point in the history

  20. close wal file when the origin size of wal buffer is larger than thre… 

    …shold
    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8929d41 View commit details
    Browse the repository at this point in the history

  21. add the size of magic string

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b2d667f View commit details
    Browse the repository at this point in the history

  22. may be fix the bug

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3297ffb View commit details
    Browse the repository at this point in the history

  23. fix with comment

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b365347 View commit details
    Browse the repository at this point in the history

  24. edit with review

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    443d1a0 View commit details
    Browse the repository at this point in the history

  25. fix test

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    130930e View commit details
    Browse the repository at this point in the history

  26. add test for wal compression

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ad021a7 View commit details
    Browse the repository at this point in the history

  27. add hot reload

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    964bf9b View commit details
    Browse the repository at this point in the history

  28. clean the code to make it more readable

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0f17197 View commit details
    Browse the repository at this point in the history

  29. reuse the byte buffer if possible

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e48b7db View commit details
    Browse the repository at this point in the history

  30. Indicate the encoding of String

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    76cc139 View commit details
    Browse the repository at this point in the history

  31. Edit according to comment

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5814812 View commit details
    Browse the repository at this point in the history

  32. spotless

    @THUMarkLau
    THUMarkLau committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d0b76f3 View commit details
    Browse the repository at this point in the history