Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add max_token_length setting to the CharGroupTokenizer #56860

Merged
merged 7 commits into from
May 20, 2020
Merged

Add max_token_length setting to the CharGroupTokenizer #56860

merged 7 commits into from
May 20, 2020

Commits on May 16, 2020

  1. add failing test case

    ADBalici committed May 16, 2020
    Configuration menu
    Copy the full SHA
    3ce8b19 View commit details
    Browse the repository at this point in the history
  2. fix code; test passes

    ADBalici committed May 16, 2020
    Configuration menu
    Copy the full SHA
    9fa42dd View commit details
    Browse the repository at this point in the history
  3. add more tests

    ADBalici committed May 16, 2020
    Configuration menu
    Copy the full SHA
    8cf5258 View commit details
    Browse the repository at this point in the history
  4. updated documentation

    ADBalici committed May 16, 2020
    Configuration menu
    Copy the full SHA
    89cbcc7 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2020

  1. small refactoring

    ADBalici committed May 19, 2020
    Configuration menu
    Copy the full SHA
    3609c1d View commit details
    Browse the repository at this point in the history

Commits on May 20, 2020

  1. Removing unused import

    Christoph Büscher authored May 20, 2020
    Configuration menu
    Copy the full SHA
    48366f3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    431fd1a View commit details
    Browse the repository at this point in the history