Skip to content

Commit

Permalink
Merge pull request #3817 from elasota/oversized-probs-clarification
Browse files Browse the repository at this point in the history
Clarify that probability tables must not contain non-zero probabilities for invalid values
  • Loading branch information
Cyan4973 authored Jan 13, 2024
2 parents 7f76d37 + c5bf96f commit 7971fd1
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions doc/zstd_compression_format.md
Original file line number Diff line number Diff line change
Expand Up @@ -1124,6 +1124,9 @@ When last symbol reaches cumulated total of `1 << Accuracy_Log`,
decoding is complete.
If the last symbol makes cumulated total go above `1 << Accuracy_Log`,
distribution is considered corrupted.
If this process results in a non-zero probability for a value outside of the
valid range of values that the FSE table is defined for, even if that value is
not used, then the data is considered corrupted.

Then the decoder can tell how many bytes were used in this process,
and how many symbols are present.
Expand Down

0 comments on commit 7971fd1

Please sign in to comment.