Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DRY: A modern repetition penalty that reliably prevents looping #5677

Merged
merged 13 commits into from
May 20, 2024
Merged

DRY: A modern repetition penalty that reliably prevents looping #5677

merged 13 commits into from
May 20, 2024
+137 −8

Commits on Mar 10, 2024

  1. Add DRY repetition penalty 

    Penalizes tokens that would extend the end of the input into a sequence that has previously occurred.
    @p-e-w
    p-e-w committed Mar 10, 2024
    Configuration menu
    Copy the full SHA
    b796884 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Add dry_range parameter

    @p-e-w
    p-e-w committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    85f1da0 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Merge branch 'dev' into dry

    @p-e-w
    p-e-w authored Mar 29, 2024
    Configuration menu
    Copy the full SHA
    cdfd440 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge branch 'dev' into p-e-w-dry

    @oobabooga
    oobabooga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    09b9da5 View commit details
    Browse the repository at this point in the history

  2. Reorganize the UI

    @oobabooga
    oobabooga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    f3f955c View commit details
    Browse the repository at this point in the history

  3. Remove dry_range, make DRY a LogitsProcessor

    @oobabooga
    oobabooga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a7f9754 View commit details
    Browse the repository at this point in the history

  4. Organize

    @oobabooga
    oobabooga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    bc7a54b View commit details
    Browse the repository at this point in the history

  5. Fix a bug

    @oobabooga
    oobabooga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    98da23f View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Bring parameter order in constructor in line with rest of code

    @p-e-w
    p-e-w committed May 14, 2024
    Configuration menu
    Copy the full SHA
    fc58c3b View commit details
    Browse the repository at this point in the history

  2. Support both JSON array notation and comma-separated strings for sequ… 

    …ence breakers
    @p-e-w
    p-e-w committed May 14, 2024
    Configuration menu
    Copy the full SHA
    80cbb8f View commit details
    Browse the repository at this point in the history

  3. Document DRY parameters in UI

    @p-e-w
    p-e-w committed May 14, 2024
    Configuration menu
    Copy the full SHA
    2585d07 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Organize a bit (put close to no_repeat_ngram_size in the codebase)

    @oobabooga
    oobabooga committed May 20, 2024
    Configuration menu
    Copy the full SHA
    4bc923e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into p-e-w-dry

    @oobabooga
    oobabooga committed May 20, 2024
    Configuration menu
    Copy the full SHA
    6177676 View commit details
    Browse the repository at this point in the history