Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ESM to huggingface #13662

Closed
wants to merge 27 commits into from
Closed

Add ESM to huggingface #13662

wants to merge 27 commits into from
+3,009 −53

Commits on Nov 12, 2021

  1. use cookiecutter to make esm

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    43390b3 View commit details
    Browse the repository at this point in the history

  2. port tokenizers

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    1fda860 View commit details
    Browse the repository at this point in the history

  3. first pass at esm model. 1 test failed

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    662e8f1 View commit details
    Browse the repository at this point in the history

  4. add conversion script, still works

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    fc634d2 View commit details
    Browse the repository at this point in the history

  5. copy roberta tests (except integration), all passing

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    442e92f View commit details
    Browse the repository at this point in the history

  6. make masked lm integration test

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    4e4437c View commit details
    Browse the repository at this point in the history

  7. add working integration tests

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    fca437f View commit details
    Browse the repository at this point in the history

  8. made tokenizer work and removed fast tokenizer

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    52acafb View commit details
    Browse the repository at this point in the history

  9. added extra lm models to auto mapping

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    e29e6ff View commit details
    Browse the repository at this point in the history

  10. make style

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    2839cef View commit details
    Browse the repository at this point in the history

  11. make sure style and quality commands pass

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    4e2565b View commit details
    Browse the repository at this point in the history

  12. update docs

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    62afe54 View commit details
    Browse the repository at this point in the history

  13. update esm tokenization with save and special token handling

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    1959f61 View commit details
    Browse the repository at this point in the history

  14. address comments and add tokenization test

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    7bbe1f9 View commit details
    Browse the repository at this point in the history

  15. removed QA+MC models, fixed all but 2 tests

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    116e6fe View commit details
    Browse the repository at this point in the history

  16. make quality passes

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    61d17ce View commit details
    Browse the repository at this point in the history

  17. add esmconfig to auto and re-run make style/quality

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    c86897b View commit details
    Browse the repository at this point in the history

  18. rebase upstream and re-run make style/quality

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    1143e75 View commit details
    Browse the repository at this point in the history

  19. fix some more tests

    @patrickvonplaten @jasoniliu
    patrickvonplaten authored and jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    14d764e View commit details
    Browse the repository at this point in the history

  20. correct config

    @patrickvonplaten @jasoniliu
    patrickvonplaten authored and jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    75366af View commit details
    Browse the repository at this point in the history

  21. add docs to doc tree

    @patrickvonplaten @jasoniliu
    patrickvonplaten authored and jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    3953378 View commit details
    Browse the repository at this point in the history

  22. update

    @patrickvonplaten @jasoniliu
    patrickvonplaten authored and jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    9c9dd60 View commit details
    Browse the repository at this point in the history

  23. Update src/transformers/models/esm/configuration_esm.py 

    Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
    @jasoniliu @LysandreJik
    jasoniliu and LysandreJik committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    7e4670a View commit details
    Browse the repository at this point in the history

  24. Update tests/test_tokenization_esm.py 

    Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
    @jasoniliu @patrickvonplaten
    jasoniliu and patrickvonplaten committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    bb9907b View commit details
    Browse the repository at this point in the history

  25. final rebase before push

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    d1b4640 View commit details
    Browse the repository at this point in the history

  26. remove decoder tests

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    cd963f2 View commit details
    Browse the repository at this point in the history

  27. make style/quality

    @jasoniliu
    jasoniliu committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    6b4b768 View commit details
    Browse the repository at this point in the history