Skip to content

v2.2.0

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 12 Nov 22:15
· 2 commits to main since this release
b3ee783

✨ New Features

  • 1262cbb - add --quiet option to tests/run.py and refactor the runners (commit by @joanise)
  • c419518 - add a lexicon-based tokenizer, esp. for English (commit by @joanise)

🐛 Bug Fixes

  • 419507e - indent only the first line in click indented paragraphs (commit by @joanise)

⚡ Performance Improvements

  • 24a28e0 - prevent quadratic time cost of degenerate inputs for lexicon-based tok (commit by @joanise)

♻️ Refactors

  • cf38989 - tests: quiet and reformat some test suites (commit by @joanise)
  • 5682125 - simplify merge_if_same_label to clearer merge_same_type_tokens (commit by @joanise)
  • d662622 - move merge_non_word_tokens and split_non_word_tokens to utils (commit by @joanise)
  • 163bc39 - import utils as a whole instead of each function (commit by @joanise)
  • c3d73bf - change tokens from a a custom dict to a Token class (PR #406 by @joanise)

✅ Tests

  • 2b8a803 - heroku: exercise the real Heroku server command in CI (commit by @joanise)
  • 0b2c83c - better unit testing for mappings.utils (commit by @joanise)

🔧 Chores

  • b2bd476 - migrate the pre-commit config to 4.x style (commit by @joanise)