Use reduce-scatter coalescing for FSDP#6024

Merged

JackCaoG merged 3 commits intomasterfrom jeffhataws_fsdp_coaelesce

Aug 2, 2024

+166-52

Commits on Mar 15, 2024

Separate PR for FSDP using Reduce-Scatter with bucketing/coalescing
jeffhataws
committed
Allgather Reduction Optimization in FSDP

Mason Fu
authored and
jeffhataws
committed

Commits on Aug 1, 2024

Merge branch 'master' into jeffhataws_fsdp_coaelesce
jeffhataws
authored