Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generate: Add new decoding strategy "DoLa" in .generate() #29619

Merged
merged 33 commits into from
Jul 9, 2024
Merged

Generate: Add new decoding strategy "DoLa" in .generate() #29619

merged 33 commits into from
Jul 9, 2024

Commits on Jul 9, 2024

  1. add support for DoLa decoding

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    5c35893 View commit details
    Browse the repository at this point in the history

  2. add docs; remove deprecated function

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    bb66df5 View commit details
    Browse the repository at this point in the history

  3. add test code for DoLa decoding

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    9769d6d View commit details
    Browse the repository at this point in the history

  4. update docs and paper link

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    4dea208 View commit details
    Browse the repository at this point in the history

  5. solved the issues that made tests failed on CircleCI

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    1bcdf79 View commit details
    Browse the repository at this point in the history

  6. ruff reformatted

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    c31d664 View commit details
    Browse the repository at this point in the history

  7. update DoLa decoding; test cases for llama/mistral/mixtral/gemma; docs

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8ea188b View commit details
    Browse the repository at this point in the history

  8. fix formatting; fix failed test cases

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    76708c8 View commit details
    Browse the repository at this point in the history

  9. fix other test cases

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    419be60 View commit details
    Browse the repository at this point in the history

  10. ruff reformatted; mamba cache issue unsolved

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    69a11e6 View commit details
    Browse the repository at this point in the history

  11. remove keyword argument 'model_inputs' to match upstream changes

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    87fc406 View commit details
    Browse the repository at this point in the history

  12. improve documentation

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    efe3e34 View commit details
    Browse the repository at this point in the history

  13. fixed suggestions from @gante

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8654787 View commit details
    Browse the repository at this point in the history

  14. ruff reformated

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    7fcf990 View commit details
    Browse the repository at this point in the history

  15. moved config warning of dola generation from utils.py to `configura… 

    …tion_utils.py`
    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    21a646a View commit details
    Browse the repository at this point in the history

  16. fixed suggestions from @amyeroberts

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    2b81d73 View commit details
    Browse the repository at this point in the history

  17. fixed format issue; removed print; added explanation

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    cc067cc View commit details
    Browse the repository at this point in the history

  18. remove trailing whitespace

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    679afea View commit details
    Browse the repository at this point in the history

  19. ruff reformat to pass test

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    7e9367b View commit details
    Browse the repository at this point in the history

  20. fixed suggestions from @amyeroberts on Mar 28

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    4bd54c8 View commit details
    Browse the repository at this point in the history

  21. fix failed CI tests

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    92de5cd View commit details
    Browse the repository at this point in the history

  22. ruff reformatted; fixed missing argument generation_config

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    cff5661 View commit details
    Browse the repository at this point in the history

  23. make dola_layers not optional

    @voidism @gante
    voidism authored and gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    ba61bf4 View commit details
    Browse the repository at this point in the history

  24. fix divergence w main

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    87ea8d8 View commit details
    Browse the repository at this point in the history

  25. fix dola test on mamba

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    57c89af View commit details
    Browse the repository at this point in the history

  26. rwkv test (wont fix

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    1c44900 View commit details
    Browse the repository at this point in the history

  27. slow tests running in fp16

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    9d9f894 View commit details
    Browse the repository at this point in the history

  28. make fixup

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    a8993ef View commit details
    Browse the repository at this point in the history

  29. remove redundant fn

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    aaf560f View commit details
    Browse the repository at this point in the history

  30. final rebase divergences

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    dc2192c View commit details
    Browse the repository at this point in the history

  31. this one was missing

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    520202d View commit details
    Browse the repository at this point in the history

  32. a few more nits

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    ce64a5f View commit details
    Browse the repository at this point in the history

  33. skip stateful models

    @gante
    gante committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8b6653c View commit details
    Browse the repository at this point in the history