Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor zstd decoder #498

Merged
merged 35 commits into from
Feb 24, 2022
Merged

Refactor zstd decoder #498

merged 35 commits into from
Feb 24, 2022

Commits on Jan 31, 2022

  1. Refactor zstd decoder

    @klauspost
    klauspost committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    1a14c30 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2022

  1. Merge branch 'master' into refactor-zstd-decoder

    @klauspost
    klauspost committed Feb 9, 2022
    Configuration menu
    Copy the full SHA
    b5ab519 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2022

  1. Make it compile

    @klauspost
    klauspost committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    984fc8f View commit details
    Browse the repository at this point in the history

  2. Fix up single decodes.

    @klauspost
    klauspost committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    dca58e6 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2022

  1. Merge branch 'master' into refactor-zstd-decoder

    @klauspost
    klauspost committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    f01cd33 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2022

  1. Almost working now...

    @klauspost
    klauspost committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    3c54049 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2022

  1. Tests pass.

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    8bf62b7 View commit details
    Browse the repository at this point in the history

  2. Avoid a few allocs

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    ac20ec2 View commit details
    Browse the repository at this point in the history

  3. Add stream decompression with no goroutines.

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    9a9ac6b View commit details
    Browse the repository at this point in the history

  4. Check FrameContentSize and max decoded size.

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    b2951ef View commit details
    Browse the repository at this point in the history

  5. Remove unused var+func.

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    9d525e5 View commit details
    Browse the repository at this point in the history

  6. Tweaks and cleanup

    @klauspost
    klauspost committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    b74ecce View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2022

  1. Use maxsize as documented.

    @klauspost
    klauspost committed Feb 19, 2022
    Configuration menu
    Copy the full SHA
    e217e78 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2022

  1. Merge branch 'master' into refactor-zstd-decoder

    @klauspost
    klauspost committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    6598a07 View commit details
    Browse the repository at this point in the history

  2. Ensure history from frames cannot overlap.

    @klauspost
    klauspost committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    561b94c View commit details
    Browse the repository at this point in the history

  3. Fix deadlock on error.

    @klauspost
    klauspost committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    3db2dcb View commit details
    Browse the repository at this point in the history

  4. Stricter framecontent size checks and consistency.

    @klauspost
    klauspost committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    55e4c4b View commit details
    Browse the repository at this point in the history

  5. Fix short test.

    @klauspost
    klauspost committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    d6e790a View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2022

  1. Add bench

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    8b43a92 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into refactor-zstd-decoder

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    d0ce155 View commit details
    Browse the repository at this point in the history

  3. Reject big RLE/RAW blocks as per facebook/zstd#3072 

    Clean up error returns to cancel when context is cancelled.
    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    50a135c View commit details
    Browse the repository at this point in the history

  4. Use os.FileInfo for Go 1.15.

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    d731396 View commit details
    Browse the repository at this point in the history

  5. Break all on errors

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    03b301a View commit details
    Browse the repository at this point in the history

  6. Move sync code to separate method.

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    4c5a306 View commit details
    Browse the repository at this point in the history

  7. Don't read sent error.

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    d3974d3 View commit details
    Browse the repository at this point in the history

  8. Fix consistent error reporting and dict inits.

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    133d52c View commit details
    Browse the repository at this point in the history

  9. Fix error message

    @klauspost
    klauspost committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    2b89e67 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2022

  1. Check if huff0 X4 blocks match size exactly.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    606373a View commit details
    Browse the repository at this point in the history

  2. Fix decoder leakage.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    a197f86 View commit details
    Browse the repository at this point in the history

  3. Forward blocks, so we don't risk run-away decoding.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    d1f91e2 View commit details
    Browse the repository at this point in the history

  4. Fix test race

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    e7906eb View commit details
    Browse the repository at this point in the history

  5. Save last before sending.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    7a09f3d View commit details
    Browse the repository at this point in the history

  6. Reuse history between async calls.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    f5e0961 View commit details
    Browse the repository at this point in the history

  7. Protect local frame.

    @klauspost
    klauspost committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    6cabc28 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. Clarify error msg

    @klauspost
    klauspost committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    f20d563 View commit details
    Browse the repository at this point in the history