Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flax Remat for LongT5 #17994

Merged
merged 21 commits into from
Aug 14, 2022
Merged

Flax Remat for LongT5 #17994

merged 21 commits into from
Aug 14, 2022
+149 −39

Commits on Jun 23, 2022

  1. [Flax] Add remat (gradient checkpointing)

    @sanchit-gandhi
    sanchit-gandhi committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    93c0a2c View commit details
    Browse the repository at this point in the history

  2. fix variable naming in test

    @sanchit-gandhi
    sanchit-gandhi committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    201731d View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. flip: checkpoint using a method

    @sanchit-gandhi
    sanchit-gandhi committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    90443a8 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. fix naming

    @sanchit-gandhi
    sanchit-gandhi committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    80188b6 View commit details
    Browse the repository at this point in the history

  2. fix class naming

    @sanchit-gandhi
    sanchit-gandhi committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    ea8150a View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2022

  1. apply PVP's suggestions from code review

    @sanchit-gandhi
    sanchit-gandhi committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    c791574 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2022

  1. add gradient_checkpointing to examples

    @KMFODA
    KMFODA committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    250fa33 View commit details
    Browse the repository at this point in the history

  2. Add gradient_checkpointing to run_mlm_flax

    @KMFODA
    KMFODA committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    9bd1c81 View commit details
    Browse the repository at this point in the history

  3. Add remat to longt5

    @KMFODA
    KMFODA committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    3c96873 View commit details
    Browse the repository at this point in the history

  4. Add gradient checkpointing test longt5

    @KMFODA
    KMFODA committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    eeb1dad View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2022

  1. Fix args errors

    @KMFODA
    KMFODA committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    bd82906 View commit details
    Browse the repository at this point in the history

  2. Fix remaining tests

    @KMFODA
    KMFODA committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    66bd8fe View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2022

  1. Merge remote-tracking branch 'origin/main' into flax-remat-kf

    @KMFODA
    KMFODA committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    1378495 View commit details
    Browse the repository at this point in the history

  2. Make fixup & quality fixes

    @KMFODA
    KMFODA committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    cd1edc3 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2022

  1. replace kwargs

    @KMFODA
    KMFODA committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    8ab6c4f View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2022

  1. remove unecessary kwargs

    @KMFODA
    KMFODA committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    27dfcbf View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into flax-remat-kf

    @KMFODA
    KMFODA committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    f47f360 View commit details
    Browse the repository at this point in the history

  3. Make fixup changes

    @KMFODA
    KMFODA committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    4c9c50c View commit details
    Browse the repository at this point in the history

  4. revert long_t5_flax changes

    @KMFODA
    KMFODA committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    72c60d9 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2022

  1. Remove return_dict and copy to LongT5

    @KMFODA
    KMFODA committed Aug 9, 2022
    Configuration menu
    Copy the full SHA
    288edbb View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2022

  1. Remove test_gradient_checkpointing

    @KMFODA
    KMFODA committed Aug 10, 2022
    Configuration menu
    Copy the full SHA
    092359c View commit details
    Browse the repository at this point in the history