Skip to content

Commit

Permalink
Update pytorch_lightning/plugins/training_type/deepspeed.py
Browse files Browse the repository at this point in the history
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
  • Loading branch information
SeanNaren and carmocca committed Feb 21, 2021
1 parent 973b43c commit 5a536cf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pytorch_lightning/plugins/training_type/deepspeed.py
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,7 @@ def __init__(
0.0 results in dynamic loss scaling, otherwise static (Default: 0)
initial_scale_power: Power of the initial dynamic loss scale value. Loss scale is computed
by 2^initial_scale_power (Default 32)
by ``2^initial_scale_power`` (Default: 32)
loss_scale_window: Window in which to raise/lower the dynamic FP16 loss scaling value (Default: 1000)
Expand Down

0 comments on commit 5a536cf

Please sign in to comment.