Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FSDPv2] Enable auto-wrapping #6499

Merged
merged 3 commits into from
Feb 8, 2024
Merged

[FSDPv2] Enable auto-wrapping #6499

merged 3 commits into from
Feb 8, 2024

Commits on Feb 8, 2024

  1. [FSDPv2] Enable auto-wrapping 

    Summary:
This pull request enables auto-wrapping for FSDPv2 following the original
XlaFullyShardedDataParallel design and implementation.

Test Plan:
python test/spmd/test_fsdp_v2.py -v -k test_fsdp_v2_auto_wrap_
    @alanwaketan
    alanwaketan committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    7ccbf8f View commit details
    Browse the repository at this point in the history

  2. Fix the tests

    @alanwaketan
    alanwaketan committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    b4eb6c1 View commit details
    Browse the repository at this point in the history

  3. Fix the linters

    @alanwaketan
    alanwaketan committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    114d17e View commit details
    Browse the repository at this point in the history