Initial Lightning DeepSpeed Integration#103

Merged

minimaxir merged 2 commits intominimaxir:masterfrom SeanNaren:feat/deepspeed

Mar 29, 2021

+12-58

Commits on Mar 15, 2021

Use DeepSpeed Plugin default, update to latest PL for AMP fixes
SeanNaren
committed
Update to 1.2.3, use max_grad_norm with fp16
SeanNaren
committed