Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add spellchecking #51

Draft
wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

Add spellchecking #51

wants to merge 16 commits into from

Commits on Mar 1, 2021

  1. load words from spelling dictionary

    @bminixhofer
    bminixhofer committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    582987f View commit details
    Browse the repository at this point in the history

  2. add spellcheck module

    @bminixhofer
    bminixhofer committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    b2ea80a View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2021

  1. more clone derives, store Arc<Tokenizer> in Rules struct

    @bminixhofer
    bminixhofer committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    7f6458a View commit details
    Browse the repository at this point in the history

  2. treat spellchecker language variants properly

    @bminixhofer
    bminixhofer committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    026ffb7 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2021

  1. switch to fst based spelling correction

    @bminixhofer
    bminixhofer committed Mar 5, 2021
    Configuration menu
    Copy the full SHA
    a0be3c2 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2021

  1. add tests for spellint, add hashset to check if word is valid

    @bminixhofer
    bminixhofer committed Mar 6, 2021
    Configuration menu
    Copy the full SHA
    f086fc5 View commit details
    Browse the repository at this point in the history

  2. add python bindings

    @bminixhofer
    bminixhofer committed Mar 6, 2021
    Configuration menu
    Copy the full SHA
    0c66c78 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2021

  1. add support for multiword spelling correction, add contraction mapping

    @bminixhofer
    bminixhofer committed Mar 13, 2021
    Configuration menu
    Copy the full SHA
    93881da View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2021

  1. proper multiword spellchecker support, ignore action=ignore_spelling … 

    …tokens
    @bminixhofer
    bminixhofer committed Mar 15, 2021
    Configuration menu
    Copy the full SHA
    16781b5 View commit details
    Browse the repository at this point in the history

  2. add whitelist support, add variant_checker struct for cleaner separation

    @bminixhofer
    bminixhofer committed Mar 15, 2021
    Configuration menu
    Copy the full SHA
    79ac926 View commit details
    Browse the repository at this point in the history

  3. extend distance to optimal string alignment distance

    @bminixhofer
    bminixhofer committed Mar 15, 2021
    Configuration menu
    Copy the full SHA
    9f15524 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2021

  1. improve docs

    @bminixhofer
    bminixhofer committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    57c06e2 View commit details
    Browse the repository at this point in the history

  2. reduce repetition, fix warnings

    @bminixhofer
    bminixhofer committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    0a738db View commit details
    Browse the repository at this point in the history

  3. fix test, qol improvement in dev scripts

    @bminixhofer
    bminixhofer committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    f474d91 View commit details
    Browse the repository at this point in the history

  4. fix doctests

    @bminixhofer
    bminixhofer committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    f1fdee7 View commit details
    Browse the repository at this point in the history

  5. fix python ci

    @bminixhofer
    bminixhofer committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    b0348bb View commit details
    Browse the repository at this point in the history