New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Correct call to torch.no_grad #5124

Merged

Borda merged 7 commits into Lightning-AI:master from 8greg8:bugfix/distributed_no_grad_context_manager

Dec 19, 2020

pytorch_lightning/utilities/distributed.py

-Original file line number
+Diff line change
@@ Expand Up / @@ -206,6 +206,6 @@ def all_gather_ddp_if_available( @@
             if sync_grads:
                 return AllGatherGrad.apply(tensor, group)
             else:
-                with torch.no_grad:
+                with torch.no_grad():
                     return AllGatherGrad.apply(tensor, group)
         return tensor