-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
release v1.5.4 #3487
Merged
release v1.5.4 #3487
Changes from 250 commits
Commits
Show all changes
668 commits
Select commit
Hold shift + click to select a range
fbff782
Refactor progress bar & summary line logic
terrelln a78c91a
Use proper unaligned access attributes
Hello71 15f32ad
[fileio] Separate parameter adaption from display update rate
terrelln f31b83f
[decompress] Fix nullptr addition & improve fuzzer
terrelln 728e73e
[legacy] Remove FORCE_MEMORY_ACCESS and only use memcpy
terrelln e2fc933
Merge branch 'dev' into http-to-https
daniellerozenblit 6e3667a
Merge pull request #3352 from daniellerozenblit/http-to-https
daniellerozenblit 6be3181
added mention of compilation flags
Cyan4973 a91e7ec
Fix corruption that rarely occurs in 32-bit mode with wlog=25
terrelln 45ed0df
check potential overflow of compressBound()
Cyan4973 e0ef09d
meson: partial fix for building pzstd on MSVC
eli-schwartz 1bc9dfe
Update documentation link to html format
Cyan4973 26e8c65
Merge branch 'dev' of github.com:facebook/zstd into dev
Cyan4973 e8401e9
meson: fix broken commit that broke the build
eli-schwartz 626425d
meson: fix warning for using too-new features
eli-schwartz ee6475c
Add missing parens around macro definition
terrelln 8745229
Merge pull request #3368 from eli-schwartz/meson-execinfo-bool
yoniko ef566c8
[circleci] Try to re-enable aarch64build
terrelln 26134b4
meson: don't require valgrind tests
eli-schwartz 9c3e18f
meson: add support for running both fast and slow version of tests
eli-schwartz 7f29c18
meson: add Linux CI
eli-schwartz 937e9d3
meson: add Windows CI
eli-schwartz 6747ba4
meson: mark a known test failure on Windows
eli-schwartz 5850839
[CI] Re-enable versions-test
terrelln 97f63ce
added unit tests for compressBound()
Cyan4973 358a237
[api][visibility] Make the visibility macros more consistent
terrelln 0c42424
[build] Fix ZSTD_LIB_MINIFY build option
terrelln 2f7b8d4
[zdict] Fix static linking only include guards
terrelln 51355e1
Merge pull request #3362 from facebook/compressBound
Cyan4973 ea24b88
decompressBound() tests
Cyan4973 2f4238e
make ZSTD_DECOMPRESSBOUND() compatible with input size 0
Cyan4973 3a484ef
Merge pull request #3373 from facebook/decompressBound
Cyan4973 ce61cb8
Merge pull request #3120 from eli-schwartz/meson-fixup
yoniko 3867c41
meson: Fix Windows CI test by pulling a more recent version msvc-dev-cmd
yoniko fba704f
Merge pull request #3374 from yoniko/fix-meson-ci-dependancy
yoniko 500f02e
Fixes two bugs in the Windows thread / pthread translation layer
yoniko ec42c92
Fix race condition in the Windows thread / pthread translation layer
yoniko aaa38b2
meson: zstreamtests should now pass on Windows
yoniko 832c1a6
minor reformatting
Cyan4973 6554596
Bump ossf/scorecard-action from 2.0.6 to 2.1.0
dependabot[bot] 79a00f8
Bump github/codeql-action from 1.0.26 to 2.1.37
dependabot[bot] 9073fe0
Merge pull request #3376 from facebook/split2
Cyan4973 3cee69a
CI: build programs on meson-windows too
eli-schwartz 67cd24b
CI: build contrib directory on meson-windows
eli-schwartz e9797b5
[pzstd] Fixes for Windows build
terrelln 26f1bf7
CR fixes
yoniko a8add43
Merge pull request #3364 from yoniko/fix-windows-mt-thread-resize-bug
yoniko 6a90c0f
Merge pull request #3289 from nmoinvaz/cmake/playtest-win
Cyan4973 a05cca6
Manually Update VS Code Copyright Definitions
felixhandte 8927f98
Update Copyright Headers 'Facebook' -> 'Meta Platforms'
felixhandte 36d5c2f
Update Copyright Year ('2021' -> 'present')
felixhandte 4c999cf
Update test-license.py
felixhandte 7f12f24
Rewrite Copyright Date Ranges from `-present` to `-2022`
felixhandte 5d693cc
Coalesce Almost All Copyright Notices to Standard Phrasing
felixhandte f302ad8
Merge pull request #3173 from felixhandte/update-copyright-company
felixhandte e4018c4
[docs] Clarify dictionary loading documentation
terrelln 3a7e2ee
Merge pull request #3340 from facebook/dependabot/github_actions/acti…
felixhandte 5f0543a
Merge pull request #3377 from facebook/dependabot/github_actions/ossf…
felixhandte ea19987
Merge pull request #3378 from facebook/dependabot/github_actions/gith…
felixhandte e3f2c8b
Pin actions/checkout Dependency to Specific Commit Hash
felixhandte 482689b
huf log speed optimization: unidirectional scan of logs + break when …
daniellerozenblit 2def93b
Merge branch 'optimal-huff-depth-speed' of github.com:daniellerozenbl…
daniellerozenblit c26f348
fix CI errors
daniellerozenblit 651a381
[build][cmake] Fix cmake with custom assembler
terrelln 0790e86
Merge pull request #3384 from felixhandte/pin-checkout-action-commit-…
felixhandte 150aa23
Pin Remaining Action Dependencies (Except OSS-Fuzz)
felixhandte 678335c
Rewrite help output to improve readability
jonpalmisc 9c93dd7
Clean up welcome message
jonpalmisc 125bcde
Update tests to expect new CLI help output
jonpalmisc 0694f14
Merge pull request #3386 from felixhandte/pin-other-action-commit-hashes
felixhandte 7607b96
Merge pull request #3385 from jonpalmisc/improve_help
Cyan4973 b6e8112
[util] Add traces enabled by --trace-file-stat
terrelln 7df6e25
[cli-tests] Add --set-exact-output to update the expected output
terrelln 31a703e
[cmake] Add noexecstack to compiler/linker flags
terrelln 40a7188
Fix `make clangbuild` & add CI
terrelln 4b40e40
[tests] Remove deprecated function from longmatch.c test
terrelln 7fe7a16
[cli-tests] Add tests that use --trace-file-stat
terrelln 382026f
Man Page Tweaks, Edits, Formatting Fixes
felixhandte 11aba9b
`make man`
felixhandte f5ea3a1
Merge pull request #3397 from felixhandte/man-page-tweaks
felixhandte ea2895c
Support decompression of compressed blocks of size ZSTD_BLOCKSIZE_MAX…
Cyan4973 8209bfc
Merge pull request #3399 from facebook/fix2577
Cyan4973 6a9c525
spec update : require minimum nb of literals for 4-streams mode
Cyan4973 089b279
Merge pull request #3398 from facebook/fix3316
Cyan4973 48f4aa7
Move deprecated annotation before static to allow C++ compilation for…
danlark1 6640377
cmake build: fix nit
Cyan4973 1f72dca
Bump ossf/scorecard-action from 2.1.0 to 2.1.2
dependabot[bot] 90597d7
Merge pull request #3394 from terrelln/issue-3010
Cyan4973 89342d1
New xp library symbol : ZSTD_CCtx_setCParams()
Cyan4973 b17743e
Signal parameter change during MT compression
Cyan4973 2a40262
External matchfinder API (#3333)
embg 481a2e1
Merge pull request #3403 from facebook/setCParams
Cyan4973 00c85b2
update ZSTD_CCts_setCParams() inline documentation
Cyan4973 bcbd395
Merge pull request #3395 from terrelln/2022-12-21-deprecated-test
Cyan4973 9fbbd74
Merge pull request #3400 from danlark1/dev
Cyan4973 4a1a79a
just add some comments to zstd_opt for improved clarity
Cyan4973 d07e72b
fixed incorrect assert
Cyan4973 3248910
Merge pull request #3248 from facebook/opt_comments1
Cyan4973 df714dd
implement suggestions
daniellerozenblit 87becc5
update regression results.csv
daniellerozenblit 1c818e3
Merge pull request #3302 from daniellerozenblit/optimal-huff-depth-speed
daniellerozenblit 5434de0
improve compression ratio of small alphabets
Cyan4973 ebba9ff
update regression results
Cyan4973 c79fb4d
update levels.sh test
Cyan4973 834fd07
Merge pull request #3391 from facebook/fix3228
Cyan4973 908e812
initial commit
daniellerozenblit d913417
Merge branch 'dev' into fuzz-max-block-size
daniellerozenblit 71dbe8f
minor: fix conversion warnings
Cyan4973 8b13000
minor simplification refactoring for timefn
Cyan4973 6f17a5d
Bump actions/checkout from 3.2.0 to 3.3.0
dependabot[bot] 59a536a
Bump actions/upload-artifact from 3.1.1 to 3.1.2
dependabot[bot] fe08137
resolve max block value in cctx and use when calculating the max bloc…
daniellerozenblit 98ca8b4
Merge pull request #3414 from facebook/dependabot/github_actions/acti…
Cyan4973 3ac0b91
Fix fuzzing with ZSTD_MULTITHREAD
danlark1 ca2ff78
Make the producer use the same amount of entropy
danlark1 1fffcfe
update minimum threshold for max block size
daniellerozenblit 4f7183d
Completely overhaul Windows CI (#3410)
embg 53eb5a7
add simple test for maxBlockSize expected functionality
daniellerozenblit fd2eb8a
Merge pull request #3402 from facebook/dependabot/github_actions/ossf…
felixhandte 06b096d
additional tests and documentation updates + allow maxBlockSize to be…
daniellerozenblit 423500d
Merge pull request #3413 from facebook/timefn
Cyan4973 796699c
fix root cause of #3416
Cyan4973 ac45e07
add explanation about new test
Cyan4973 5b26619
Add support for in-place decompression
terrelln bcfb7ad
refactor timefn
Cyan4973 a2ef23d
restore support of clock_gettime() for POSIX systems
Cyan4973 d550908
Merge pull request #3419 from facebook/fix3416
Cyan4973 14b8def
move ZSTD_BLOCKSIZE_MAX_MIN to static linking only section
daniellerozenblit f10922a
Disable Custom ASAN/MSAN Poisoning on MinGW Builds
felixhandte d78fbed
Don't Even Declare Poisoning Functions if Poisoning is Disabled
felixhandte 2086e73
missing #include for Windows
Cyan4973 5d8cfa6
Deprecate advanced streaming functions (#3408)
embg 3add5ca
Bump github/codeql-action from 2.1.37 to 2.1.38 (#3428)
dependabot[bot] 018b68f
fix msys2 symlink breakage in CI (#3429)
embg 23a356c
Merge pull request #3424 from felixhandte/disable-asan-msan-poison-mingw
felixhandte 8353a4b
fix maxBlockSize resolution + add test cases
daniellerozenblit 2ad6855
`FIO_openSrcFile()` Returns File Stat
felixhandte 5653f96
Pass `stat_t` into `*_dstFile()` Functions
felixhandte a5ed28f
Use Existing Src File Stat in `*_dstFile()` Funcs
felixhandte 860548c
[tests] Fix version test determinism
terrelln 0382076
Re-Use `stat_t` in `FIO_compressFilename_srcFile()`
felixhandte 1e3eba6
Copy Permissions from Source File
felixhandte 0d2d460
Mimic gzip chown(gid), chmod(), chown(uid) Behavior
felixhandte 7a8c8f3
Easy: Print Mode as Octal in `chmod()` Trace
felixhandte bbe65d7
Merge pull request #3423 from facebook/ptime
Cyan4973 dc1c6cc
Merge pull request #3418 from daniellerozenblit/fuzz-max-block-size
daniellerozenblit bce0382
Bugfixes for the External Matchfinder API (#3433)
embg 3f9f568
Fuzz the external matchfinder API
embg ea684c3
added c89 build test to CI
Cyan4973 cd272d7
added cygwin tests to github actions
Cyan4973 f593e54
Enable if == 1 rather than if == 0
embg 64963dc
Merge pull request #3437 from embg/fuzz_emf
embg aa385ec
fix sequence validation and bounds check in ZSTD_copySequencesToSeqSt…
daniellerozenblit abf965c
Merge pull request #3415 from facebook/dependabot/github_actions/acti…
Cyan4973 666944f
Cap hashLog & chainLog to ensure that we only use 32 bits of hash
terrelln 667eb6d
[versions-test] Work around bug in dictionary builder for older versions
terrelln 6742f20
Merge pull request #3435 from facebook/c89build
Cyan4973 bb9b9bc
Merge pull request #3431 from facebook/cygwin
Cyan4973 0cc1b0c
Delete unused Huffman functions
terrelln 3291691
Replace Huffman boolean args with flags bit set
terrelln 87e169d
Add Additional Flags to PGO Build
felixhandte aab3dd4
Add PGO Build Jobs to CI
felixhandte b4467c1
Fix bufferless API with attached dictionary
terrelln 772229a
Merge pull request #3442 from felixhandte/pgo-tests
felixhandte 3d25502
Merge pull request #3432 from felixhandte/fix-perms
felixhandte d9280af
fixed minor c89 warning
Cyan4973 cee6bec
refactor : --rm is ignored with stdout
Cyan4973 b6fd91b
update man
Cyan4973 3663faa
Bump github/codeql-action from 2.1.38 to 2.1.39
dependabot[bot] 638d502
modify sequence compression api fuzzer
daniellerozenblit 1b65727
fix nits and add new error code for invalid external sequences
daniellerozenblit f75afb6
merge dev
daniellerozenblit 6aee603
Merge pull request #3446 from facebook/dependabot/github_actions/gith…
embg 815d1d4
update external sequence error to fit error naming scheme
daniellerozenblit dc2b3e8
Fix -Wstringop-overflow warning
terrelln ced0882
Merge pull request #3443 from facebook/no_rm_w_stdout
Cyan4973 3bfd3be
Fix ZSTD_estimate* and ZSTD_initCStream() docs
embg 7fc00c1
calloc dictionary in sequence compression fuzzer rather than generati…
daniellerozenblit 9116000
Merge pull request #3439 from daniellerozenblit/sequence-validation-b…
daniellerozenblit 0a91b31
Merge branch 'dev' into fuzz-sequence-compression
daniellerozenblit 41682e6
Merge pull request #3448 from facebook/embg-doc-fix
embg 7d600c6
fix bound check for ZSTD_copySequencesToSeqStoreNoBlockDelim()
daniellerozenblit 1d636b4
Bug fix redzones by unpoisoning only the intended buffer and not the …
yoniko 2baac04
Merge pull request #3451 from yoniko/red-zones-bugfix
yoniko 63042f1
fix 32bit build errors in zstd seekable
daniellerozenblit 29a4c8c
Merge pull request #3452 from daniellerozenblit/fix-seekable-32bit
daniellerozenblit f3255bf
Merge pull request #3447 from daniellerozenblit/fuzz-sequence-compres…
daniellerozenblit db18a62
Provide more accurate error codes for busy-loop scenarios
Cyan4973 8957fef
[huf] Add generic C versions of the fast decoding loops
terrelln 321490c
[version-test] Work around bugs in v0.7.3 dict builder
terrelln efc9ae3
Merge pull request #3455 from facebook/fix3454
Cyan4973 8c85b29
disable --rm on -o command
Cyan4973 02434e0
enforce a hard fail when input files are set to be erased
Cyan4973 a82e0aa
Merge pull request #3450 from facebook/no_rm_on_o
Cyan4973 6422d1d
Bugfix: `--[no-]row-match-finder` do the opposite of what they are su…
yoniko 7b3f03b
Merge pull request #3457 from yoniko/fix-rowhash-cli
yoniko 3c21522
modify cli-test logic : ignore stderr message by default
Cyan4973 82ca008
change logic when stderr is not console : don't update progress status
Cyan4973 bda947e
[huf] Fix bug in fast C decoders
terrelln 88b7088
Merge pull request #3458 from facebook/stderr_finalStatus
Cyan4973 814f4bf
fix long offset resolution
daniellerozenblit d210628
initialize long offsets in decodecorpus
daniellerozenblit 9e4c66b
record long offsets in ZSTD_symbolEncodingTypeStats_t + add test case
daniellerozenblit 423a749
[fse] Delete unused functions
terrelln 2bde9fb
Update lib/compress/zstd_compress.c
daniellerozenblit da589a1
update CI
daniellerozenblit 5ec77ad
Merge branch 'fix-long-offsets-resolution-pointer' of github.com:dani…
daniellerozenblit b3b43f2
Fix invalid assert in 32-bit decoding
terrelln 295724b
Update .github/workflows/dev-long-tests.yml
daniellerozenblit dd7fdc9
Bump github/codeql-action from 2.1.39 to 2.2.1
dependabot[bot] 66fae56
remove big test around large offset with small window size
daniellerozenblit 0843d9b
Merge branch 'fix-long-offsets-resolution-pointer' of github.com:dani…
daniellerozenblit 0017663
Merge pull request #3460 from daniellerozenblit/fix-long-offsets-reso…
daniellerozenblit 2f74507
Simplify 32-bit long offsets decoding logic
terrelln 39ceef2
bump version number to v1.5.4
Cyan4973 71c911d
Merge pull request #3464 from facebook/dependabot/github_actions/gith…
Cyan4973 4794bbf
Merge pull request #3469 from facebook/updateVersion
Cyan4973 af09777
ensure that benchmark mode can only be invoked with zstd format
Cyan4973 64052ef
Guard against invalid sequences from external matchfinders (#3465)
embg ac0746a
Merge pull request #3470 from facebook/bench_zstd_only
Cyan4973 7f8189c
add ZSTD_c_fastExternalSequenceParsing cctxParam
embg cc3e3ac
Fix 32-bit decoding with large dictionary
terrelln c22c995
Merge pull request #3472 from terrelln/2023-02-01-fix-32-bit-decoding
Cyan4973 3fe5f1f
assert externalRepSearch != ZSTD_ps_auto
embg 31e41b3
Merge pull request #3471 from embg/fast_seq_parse
embg 71a0259
Fix ZSTD_getOffsetInfo() when nbSeq == 0
terrelln 79bdb8c
AsyncIO performance regression for small files fix (#3474)
yoniko 35835f4
Bump ilammy/msvc-dev-cmd from 1.12.0 to 1.12.1
dependabot[bot] 54a173e
Merge pull request #3477 from facebook/dependabot/github_actions/ilam…
felixhandte 9cabd15
return error code when benchmark fails
Cyan4973 58e7067
added more accurate error messages
Cyan4973 6740f8f
add error message for the (rare) compression error scenario
Cyan4973 df21ace
Merge pull request #3480 from facebook/benchFail
Cyan4973 e04706c
fix oss-fuzz case 55714
Cyan4973 cfec005
fix for v0.3 blindly ported to v0.2
Cyan4973 7eb4471
adapt v0.3 fix to v0.1
Cyan4973 b20e4e9
copy fix for v0.3 to v0.4
Cyan4973 7a1a171
port fix for v0.3 to v0.5
Cyan4973 67d7a65
port fix for v0.3 to v0.6
Cyan4973 9419747
fix legacy decoders v0.4, v0.5 and v0.6
Cyan4973 c5bf6b8
add requested check for legacy decoder v0.1
Cyan4973 c689310
rewrite legacy v0.7 bound checks to be independent of address space o…
Cyan4973 488f7c0
Merge pull request #3476 from facebook/fix55714
Cyan4973 83f8a05
Fix empty-block.zst golden decompression file
terrelln 4de9d63
minor: fix missing newline character in help page
Cyan4973 67fb9d9
Merge branch 'dev' of github.com:facebook/zstd into dev
Cyan4973 4aa3bc4
updated CHANGELOG in preparation for v1.5.4 release
Cyan4973 ff42ed1
Rename "External Matchfinder" to "Block-Level Sequence Producer" (#3484)
embg 95ffc76
updated man pages
Cyan4973 515266e
minor nit updates to README.md
Cyan4973 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
version: 2 | ||
updates: | ||
- package-ecosystem: "github-actions" | ||
directory: "/" | ||
schedule: | ||
interval: "weekly" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Check warning
Code scanning / Scorecard
Pinned-Dependencies