Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add support for simpo via cpo trainer #1772

Merged
merged 3 commits into from
Jul 24, 2024
Merged

add support for simpo via cpo trainer #1772

merged 3 commits into from
Jul 24, 2024

Commits on Jul 23, 2024

  1. add support for simpo via cpo trainer

    @winglian
    winglian committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    f6d0b90 View commit details
    Browse the repository at this point in the history

  2. add cpo_alpha / sft_weight from the paper

    @winglian
    winglian committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    841b33b View commit details
    Browse the repository at this point in the history

  3. make sure to use the right builder for simpo

    @winglian
    winglian committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    0f55980 View commit details
    Browse the repository at this point in the history