Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable ZeRO tests for CI, fix to/half function calls for LightningDistributedWrapper #6070

Merged
merged 20 commits into from
Feb 21, 2021
Merged

Enable ZeRO tests for CI, fix to/half function calls for LightningDistributedWrapper #6070

merged 20 commits into from
Feb 21, 2021

Commits on Feb 18, 2021

  1. Enable ZeRO optimization, and make sure that the lightning module hoo… 

    …k is called when we move to half precision
    SeanNaren committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    655969f View commit details
    Browse the repository at this point in the history

  2. Added test, update to function

    SeanNaren committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    75a54e2 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2021

  1. Use device type mixin

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    c5413ab View commit details
    Browse the repository at this point in the history

  2. Add precision

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    1c1c114 View commit details
    Browse the repository at this point in the history

  3. Turn off zero for checking optimizers are correct

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    1d1a1e1 View commit details
    Browse the repository at this point in the history

  4. Remove import

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    d3fcc09 View commit details
    Browse the repository at this point in the history

  5. Use FP16 Wrapper

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    f5d25fd View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into fix/enable_zero_fix_dtype

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    09289ea View commit details
    Browse the repository at this point in the history

  7. Move mixin to the base class

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    cf6bd94 View commit details
    Browse the repository at this point in the history

  8. Better name for the test, test precision move

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    8969d17 View commit details
    Browse the repository at this point in the history

  9. Added CHANGELOG.md

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    7795fcb View commit details
    Browse the repository at this point in the history

  10. Revert "Added CHANGELOG.md" 

    This reverts commit 7795fcb
    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    98c152d View commit details
    Browse the repository at this point in the history

  11. Move precision check into a separate test that requires cuda

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    47e606d View commit details
    Browse the repository at this point in the history

  12. Merge branch 'master' into fix/enable_zero_fix_dtype

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    09d7667 View commit details
    Browse the repository at this point in the history

  13. Provide ZeRO config

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    23824aa View commit details
    Browse the repository at this point in the history

  14. Revert "Revert "Added CHANGELOG.md"" 

    This reverts commit 98c152d
    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    7a6cd1e View commit details
    Browse the repository at this point in the history

  15. Support torch device as input to cuda, as is with upstream pytorch

    SeanNaren committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    49ec362 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2021

  1. Modify test to include all possible cuda variations

    SeanNaren committed Feb 20, 2021
    Configuration menu
    Copy the full SHA
    71ea9bf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into fix/enable_zero_fix_dtype 

    # Conflicts:
#	CHANGELOG.md
    SeanNaren committed Feb 20, 2021
    Configuration menu
    Copy the full SHA
    0f1b325 View commit details
    Browse the repository at this point in the history

  3. Trigger Build

    SeanNaren committed Feb 20, 2021
    Configuration menu
    Copy the full SHA
    17715c7 View commit details
    Browse the repository at this point in the history