Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added Support for guided decoding in offline interface #4130

Closed
wants to merge 37 commits into from
Closed

Added Support for guided decoding in offline interface #4130

wants to merge 37 commits into from

Commits on Apr 16, 2024

  1. first commit, added extra parameters for offline LLM, issue with work… 

    …ers during testing
    @kevinbu233
    kevinbu233 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    a5aeec2 View commit details
    Browse the repository at this point in the history

  2. clean up cod code

    @kevinbu233
    kevinbu233 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    dcbfc69 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. add skip cleanup

    @simon-mo
    simon-mo committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    bd4d84c View commit details
    Browse the repository at this point in the history

  2. Changed model and sampling parameters, cleaned up naming

    @kevinbu233
    kevinbu233 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    76c0924 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. cleand up code and created helper functions

    @kevinbu233
    kevinbu233 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4709a98 View commit details
    Browse the repository at this point in the history

  2. first merge resolved

    @kevinbu233
    kevinbu233 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    aab046d View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. fix format

    @kevinbu233
    kevinbu233 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    84b1442 View commit details
    Browse the repository at this point in the history

  2. fix merge conflict

    @kevinbu233
    kevinbu233 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    1d6abe4 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. added docstrings for sampling params guided options

    @kevinbu233
    kevinbu233 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    daa2c8f View commit details
    Browse the repository at this point in the history

  2. fix merge conflict with main

    @kevinbu233
    kevinbu233 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    35c73ee View commit details
    Browse the repository at this point in the history

  3. :erge remote-tracking branch 'upstream/main' into yihuan_issue3536 

    Merge with main
    @kevinbu233
    kevinbu233 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    9e454c5 View commit details
    Browse the repository at this point in the history

  4. fixed support for multiple sampling params for LLM

    @kevinbu233
    kevinbu233 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    ef4cf6f View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    945125d View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. added noqa for extra long line

    @kevinbu233
    kevinbu233 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    1c0769d View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Update tests/entrypoints/test_local_LLM.py 

    Co-authored-by: Jack Boylan <70636379+jackboyla@users.noreply.github.com>
    @simon-mo @jackboyla
    simon-mo and jackboyla authored May 1, 2024
    Configuration menu
    Copy the full SHA
    062f0bc View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Merge branch 'main' of github.com:vllm-project/vllm into yihuan_issue… 

    …3536
    @simon-mo
    simon-mo committed May 2, 2024
    Configuration menu
    Copy the full SHA
    05a2512 View commit details
    Browse the repository at this point in the history

  2. fix typing

    @simon-mo
    simon-mo committed May 2, 2024
    Configuration menu
    Copy the full SHA
    438ab37 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. fix test and more refactoring

    @simon-mo
    simon-mo committed May 3, 2024
    Configuration menu
    Copy the full SHA
    06c2205 View commit details
    Browse the repository at this point in the history

  2. use x2

    @simon-mo
    simon-mo committed May 3, 2024
    Configuration menu
    Copy the full SHA
    4158d78 View commit details
    Browse the repository at this point in the history

  3. lint

    @simon-mo
    simon-mo committed May 3, 2024
    Configuration menu
    Copy the full SHA
    0d9e5a5 View commit details
    Browse the repository at this point in the history

  4. fix isort

    @simon-mo
    simon-mo committed May 3, 2024
    Configuration menu
    Copy the full SHA
    ff9ba7f View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. merge with main

    @kevinbu233
    kevinbu233 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    bbb59bf View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. fixing merge issues

    @kevinbu233
    kevinbu233 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    d779f86 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    f923677 View commit details
    Browse the repository at this point in the history

  3. fixed merge

    @kevinbu233
    kevinbu233 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    a15b511 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    292264a View commit details
    Browse the repository at this point in the history

  5. format

    @kevinbu233
    kevinbu233 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    77d42a8 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. finished merge first draft

    @kevinbu233
    kevinbu233 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    60ab6f6 View commit details
    Browse the repository at this point in the history

  2. merged main

    @kevinbu233
    kevinbu233 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    ae23772 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    3fb6258 View commit details
    Browse the repository at this point in the history

  2. fixed merge conflict and fixed suggestions

    @kevinbu233
    kevinbu233 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    75cf9a7 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    c429ef8 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2024

  1. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    da89c1b View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. fix test_openai error

    @kevinbu233
    kevinbu233 committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    6c8b82a View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge remote-tracking branch 'upstream/main' into yihuan_issue3536

    @kevinbu233
    kevinbu233 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4e759d9 View commit details
    Browse the repository at this point in the history

  2. fixing response_format test

    @kevinbu233
    kevinbu233 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4ac8abb View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. temporay push

    @kevinbu233
    kevinbu233 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    2eedeba View commit details
    Browse the repository at this point in the history