🐛 Fix very rare case of ?bad? bytes payload that cause decode/encode errors

[Ousret]

Linked to psf/requests#5797 (comment)

[codecov-commenter]

Codecov Report

Merging #40 (702735d) into master (523c71b) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master      #40   +/-   ##
=======================================
  Coverage   84.56%   84.56%           
=======================================
  Files          13       13           
  Lines         920      920           
=======================================
  Hits          778      778           
  Misses        142      142           

Impacted Files	Coverage Δ
charset_normalizer/normalizer.py	85.60% <100.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 523c71b...702735d. Read the comment docs.

[potiuk]

Cool

[Ousret]

So I can confirm that this patch fixes the issue. The websites that raise that are behind the Cloudflare app-firewall I noticed.
Does not seems to happen every time as you noticed.

[Ousret]

I am merging this now as it does not interfere with everything else. This 'bug' is a very edge case and seems related to errors in TX.

[potiuk]

Cool. I can re-run the test tomorrow for all 33.000 sites - it was pretty repeatable with 16-18 cases per run.