Code

Version 2.0 - Candidate#45

Code

Merged

Ousret merged 38 commits intomasterjawah/charset_normalizer:masterfrom v2-proposaljawah/charset_normalizer:v2-proposalCopy head branch name to clipboardJul 2, 2021

+2,914-3,389

Commits

Commits on Jun 24, 2021

• ❇️ 🎉 Unattended v2 ongoing development | Code refactoring | Huge performance gain | Maintainability Improvement | Base commit

  Show description for 9d73ebb
  Ousret

  committed
  9d73ebb

  Copy full SHA for 9d73ebb

• 🔥 Remove faulty test file/data

  Ousret

  committed
  7b12493

  Copy full SHA for 7b12493

• 🔧 Remove 3.10

  Ousret

  committed
  0c39e38

  Copy full SHA for 0c39e38

• ⬇️ Remove f-strings (py 3.5 bc)

  Ousret

  committed
  179d9f6

  Copy full SHA for 179d9f6

• ⬇️ Remove f-strings (py 3.5 bc) *2

  Ousret

  committed
  2e45549

  Copy full SHA for 2e45549

Commits on Jun 26, 2021

• 📝 🎨 Add comments, rem var typing (3.6+), bc insurance wip

  Ousret

  committed
  91d16db

  Copy full SHA for 91d16db

• 🎨 ⬇️ rem var typing (3.5 bc)

  Ousret

  committed
  f9ac476

  Copy full SHA for f9ac476

• 🎨 ⬇️ rem var typing (3.5 bc) *2

  Ousret

  committed
  3a673c7

  Copy full SHA for 3a673c7

• 🔧 PathLike backport compat

  Ousret

  committed
  ab7ee4f

  Copy full SHA for ab7ee4f

• 🔧 🐛 Using OrderedDict to load assets JSON (py 3.5 bc)

  Ousret

  committed
  dcb3006

  Copy full SHA for dcb3006

• 🔧 ✔️ Add py 3.10 for testing GHA

  Ousret

  committed
  01dab7f

  Copy full SHA for 01dab7f

• 🔧 3.10 not yet available GHA, set 3.10.0-beta.3 instead

  Ousret

  committed
  f0d85ac

  Copy full SHA for f0d85ac

• ❇️ Handle better bom/sig when it is required by decoder (each chunk md analysis)

  Ousret

  committed
  576117d

  Copy full SHA for 576117d

• re-implement w_counter (bc purpose) but deprecated

  Ousret

  committed
  ac4f1c9

  Copy full SHA for ac4f1c9

Commits on Jun 29, 2021

• 📝 Update UPGRADE.md and CONTRIBUTING.md

  Ousret

  committed
  0b8bbf6

  Copy full SHA for 0b8bbf6

• ❇️ re-implement function normalize (BC purpose)

  Ousret

  committed
  c3fff80

  Copy full SHA for c3fff80

• 🐛 Fix consistent py3.5 run (missing ordereddict for bom/sig marks)

  Ousret

  committed
  3c49b75

  Copy full SHA for 3c49b75

• 🎨 typing adjustments / fix common mistakes

  Ousret

  committed
  6f26cb8

  Copy full SHA for 6f26cb8

• 🎨 Improve/Fix tiny mistakes seen in advanced tests scenario

  Ousret

  committed
  4ad9a83

  Copy full SHA for 4ad9a83

• ❇️ Add scripts (BC+Detect Coverage)

  Ousret

  committed
  9d383c8

  Copy full SHA for 9d383c8

• 🔥 Remove deprecated ./paper test files

  Ousret

  committed
  d4dc584

  Copy full SHA for d4dc584

• 📝 Update issue templates

  Ousret

  committed
  8a3e362

  Copy full SHA for 8a3e362

• ❇️ Add CodeQL analysis + detector coverage + chardet BC coverage

  Ousret

  committed
  50a7394

  Copy full SHA for 50a7394

• 🔧 wrong default path for bc/coverage scripts

  Ousret

  committed
  f4b2c68

  Copy full SHA for f4b2c68

• 🔧 re-align requirement with actual results (calibration)

  Ousret

  committed
  1da0bf6

  Copy full SHA for 1da0bf6

• 🔧 rem useless arg

  Ousret

  committed
  95ccf9f

  Copy full SHA for 95ccf9f

Commits on Jun 30, 2021

• 📝 Update README and CONTRIBUTING

  Ousret

  committed
  3dcfdeb

  Copy full SHA for 3dcfdeb

• ❇️ Add performance CI/CD verification against Chardet

  Ousret

  committed
  0d6460c

  Copy full SHA for 0d6460c

• 🔧 relative path fix (perf ci/cd)

  Ousret

  committed
  566ef93

  Copy full SHA for 566ef93

• ❇️ Add md plugin CjkInvalidStopPlugin

  Show description for 5d189ba
  Ousret

  committed
  5d189ba

  Copy full SHA for 5d189ba

• 📝 readme update (stats)

  Ousret

  committed
  0e2eddd

  Copy full SHA for 0e2eddd

Commits on Jul 2, 2021

• ❇️ Take the BC level of the (legacy) function detect one step further

  Show description for ca73989
  Ousret

  committed
  ca73989

  Copy full SHA for ca73989

• 🐛 Function is_accentuated could raise ValueError

  Ousret

  committed
  7c1b7e3

  Copy full SHA for 7c1b7e3

• 🐛 The SIG for the GB18030 CP was incomplete

  Ousret

  committed
  1a77b48

  Copy full SHA for 1a77b48

• 📝 Update README.md (Perf)

  Ousret

  committed
  7b19bd9

  Copy full SHA for 7b19bd9

• ✔️ Update tests according to recent change on the legacy detect return (BC tests)

  Ousret

  committed
  6dd3530

  Copy full SHA for 6dd3530

• ⚡ ❇️ Improvement over RAM consumption and 🎨 minor code improvement in models.py

  Ousret

  committed
  e7b9053

  Copy full SHA for e7b9053

• 🐛 Fix CLI --version (bad usage of ArgParser)

  Ousret

  committed
  ae72624

  Copy full SHA for ae72624