Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose DeepSpeed FP16 parameters due to loss instability #6115

Merged
merged 4 commits into from
Feb 21, 2021
Merged

Expose DeepSpeed FP16 parameters due to loss instability #6115

merged 4 commits into from
Feb 21, 2021

Commits on Feb 21, 2021

  1. Expose deepspeed config parameters to init function due to instabilit… 

    …y in parameters
    SeanNaren committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    bf9cd51 View commit details
    Browse the repository at this point in the history

  2. See if tests can run on normal CI, without special tests

    SeanNaren committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    bffb11c View commit details
    Browse the repository at this point in the history

  3. Add changelog

    SeanNaren committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    973b43c View commit details
    Browse the repository at this point in the history

  4. Update pytorch_lightning/plugins/training_type/deepspeed.py 

    Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
    @SeanNaren @carmocca
    SeanNaren and carmocca committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    5a536cf View commit details
    Browse the repository at this point in the history