Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature] Add StochasticWeightAveraging (SWA) callback #5640

Merged
merged 69 commits into from
Feb 11, 2021
Merged

[feature] Add StochasticWeightAveraging (SWA) callback #5640

merged 69 commits into from
Feb 11, 2021

Commits on Jan 24, 2021

  1. add swa callback

    @tchaton
    tchaton committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    4665196 View commit details
    Browse the repository at this point in the history

  2. switch back to 1.6.0

    @tchaton
    tchaton committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    be261a8 View commit details
    Browse the repository at this point in the history

  3. remove optimizer_step

    @tchaton
    tchaton committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    d999312 View commit details
    Browse the repository at this point in the history

  4. move super

    @tchaton
    tchaton committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    e9f89b4 View commit details
    Browse the repository at this point in the history

  5. update

    @tchaton
    tchaton committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    c70c35e View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2021

  1. forgot update_parameters

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    b7ceb5f View commit details
    Browse the repository at this point in the history

  2. update on comments

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    6a897bc View commit details
    Browse the repository at this point in the history

  3. works for ddp

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    051d201 View commit details
    Browse the repository at this point in the history

  4. resolve flake8

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    0bab9ac View commit details
    Browse the repository at this point in the history

  5. remove set_model

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    0028fe7 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feat/swa' of https://github.com/PyTorchLightning/pytorc… 

    …h-lightning into feat/swa
    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    3771884 View commit details
    Browse the repository at this point in the history

  7. resolve flake8

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    c886875 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    415e5c6 View commit details
    Browse the repository at this point in the history

  9. resolve cpu

    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    663608e View commit details
    Browse the repository at this point in the history

  10. Merge branch 'feat/swa' of https://github.com/PyTorchLightning/pytorc… 

    …h-lightning into feat/swa
    @tchaton
    tchaton committed Jan 25, 2021
    Configuration menu
    Copy the full SHA
    0379f3d View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2021

  1. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    9cf56a4 View commit details
    Browse the repository at this point in the history

  2. resolve flake8

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    774835d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/swa' of https://github.com/PyTorchLightning/pytorc… 

    …h-lightning into feat/swa
    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    377235f View commit details
    Browse the repository at this point in the history

  4. resolve flake8

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    c457608 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    83eb0b1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    d25fb36 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    efe2c64 View commit details
    Browse the repository at this point in the history

  8. update

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    b0bb85e View commit details
    Browse the repository at this point in the history

  9. Merge branch 'feat/swa' of https://github.com/PyTorchLightning/pytorc… 

    …h-lightning into feat/swa
    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    52d5400 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'release/0.2-dev' of https://github.com/PyTorchLightning… 

    …/pytorch-lightning into feat/swa
    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    b9b9264 View commit details
    Browse the repository at this point in the history

  11. update on comments

    @tchaton
    tchaton committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    f0452f2 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2021

  1. Merge branch 'release/1.2-dev' into feat/swa

    @tchaton
    tchaton committed Jan 27, 2021
    Configuration menu
    Copy the full SHA
    4ce6ce0 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review 

    Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
    @Borda @SeanNaren
    Borda and SeanNaren committed Jan 27, 2021
    Configuration menu
    Copy the full SHA
    fce8327 View commit details
    Browse the repository at this point in the history

  3. fix

    @Borda
    Borda committed Jan 27, 2021
    Configuration menu
    Copy the full SHA
    8704023 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2021

  1. resolve on comments

    @tchaton
    tchaton committed Jan 28, 2021
    Configuration menu
    Copy the full SHA
    33bf190 View commit details
    Browse the repository at this point in the history

  2. update

    @tchaton
    tchaton committed Jan 28, 2021
    Configuration menu
    Copy the full SHA
    8782eaa View commit details
    Browse the repository at this point in the history

  3. typo

    @tchaton
    tchaton committed Jan 28, 2021
    Configuration menu
    Copy the full SHA
    def691f View commit details
    Browse the repository at this point in the history

  4. credit to Pytorch Team

    @tchaton
    tchaton committed Jan 28, 2021
    Configuration menu
    Copy the full SHA
    172cb68 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2021

  1. update

    @tchaton
    tchaton committed Feb 3, 2021
    Configuration menu
    Copy the full SHA
    d683849 View commit details
    Browse the repository at this point in the history

  2. add space to docstring

    @tchaton
    tchaton committed Feb 3, 2021
    Configuration menu
    Copy the full SHA
    ddfe9d8 View commit details
    Browse the repository at this point in the history

  3. resolve some bugs

    @tchaton
    tchaton committed Feb 3, 2021
    Configuration menu
    Copy the full SHA
    76a057f View commit details
    Browse the repository at this point in the history

  4. resolve bug

    Ubuntu committed Feb 3, 2021
    Configuration menu
    Copy the full SHA
    c0e36f0 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2021

  1. Revert finetuning changes

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    2e2c412 View commit details
    Browse the repository at this point in the history

  2. Minor changes

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    702b853 View commit details
    Browse the repository at this point in the history

  3. Remove pruning check because it was added in 1.4.0 and that is our mi… 

    …nimal torch version
    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    5ba2a48 View commit details
    Browse the repository at this point in the history

  4. Fix SWA indices. Improve tests

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    bbc377e View commit details
    Browse the repository at this point in the history

  5. Use properties. Move skip_backward on fn higher

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    1b47b99 View commit details
    Browse the repository at this point in the history

  6. Check backward call count

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    dfcb9ce View commit details
    Browse the repository at this point in the history

  7. Address comments

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    ca10126 View commit details
    Browse the repository at this point in the history

  8. Add misconfig tests

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    a4c2b0f View commit details
    Browse the repository at this point in the history

  9. Merge branch 'release/1.2-dev' into feat/swa

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    8e3d328 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'release/1.2-dev' into feat/swa

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    50b8326 View commit details
    Browse the repository at this point in the history

  11. pre-commit

    @carmocca
    carmocca committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    1100db2 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2021

  1. Apply suggestions from code review 

    Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
    @carmocca @Borda
    carmocca and Borda committed Feb 5, 2021
    Configuration menu
    Copy the full SHA
    e2003a5 View commit details
    Browse the repository at this point in the history

  2. Update tests/callbacks/test_swa.py

    @carmocca
    carmocca committed Feb 5, 2021
    Configuration menu
    Copy the full SHA
    bf051fb View commit details
    Browse the repository at this point in the history

  3. Revert "Remove pruning check because it was added in 1.4.0 and that i… 

    …s our minimal torch version"

This reverts commit 5ba2a48.
    @carmocca
    carmocca committed Feb 5, 2021
    Configuration menu
    Copy the full SHA
    53106cd View commit details
    Browse the repository at this point in the history

  4. Use on_train_end. Fix tests. Add ddp_cpu test

    @carmocca
    carmocca committed Feb 5, 2021
    Configuration menu
    Copy the full SHA
    d019ba8 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2021

  1. Apply suggestions from code review

    @Borda
    Borda committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    8b6d55c View commit details
    Browse the repository at this point in the history

  2. WIP

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    4ffcb42 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'release/1.2-dev' into feat/swa

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    53136cc View commit details
    Browse the repository at this point in the history

  4. yapf

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    9669cbd View commit details
    Browse the repository at this point in the history

  5. Revert change

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    3316b12 View commit details
    Browse the repository at this point in the history

  6. Minor changes

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    4eb4bc4 View commit details
    Browse the repository at this point in the history

  7. Typo

    @carmocca
    carmocca committed Feb 9, 2021
    Configuration menu
    Copy the full SHA
    5d67b23 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2021

  1. Add beta warning

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    cda86e1 View commit details
    Browse the repository at this point in the history

  2. Docs fixes

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    fc4ce1a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'release/1.2-dev' into feat/swa

    SeanNaren committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    781b367 View commit details
    Browse the repository at this point in the history

  4. Call base file

    SeanNaren committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    c4d1669 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'release/1.2-dev' into feat/swa

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    70343c3 View commit details
    Browse the repository at this point in the history

  6. Skip test on Windows

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    4568bfa View commit details
    Browse the repository at this point in the history

  7. .

    @Borda
    Borda committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    02da3a9 View commit details
    Browse the repository at this point in the history

  8. ..

    @Borda
    Borda committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    adf7931 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'release/1.2-dev' into feat/swa

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    e46383e View commit details
    Browse the repository at this point in the history

  10. Correct variable

    @carmocca
    carmocca committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    7fae40d View commit details
    Browse the repository at this point in the history