Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FSDP2] full finetune: move state dict to cpu when cpu offloading #1495

Merged
merged 6 commits into from
Sep 5, 2024
Merged

[FSDP2] full finetune: move state dict to cpu when cpu offloading #1495

merged 6 commits into from
Sep 5, 2024

Commits on Sep 4, 2024

  1. move state dict to cpu when cpu offloading 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8adb728 View commit details
    Browse the repository at this point in the history

  2. remove debug 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    4582779 View commit details
    Browse the repository at this point in the history

  3. linter 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    afec67c View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. [FSDP2] move param from cpu to gpu when covnerting to full state dict 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ee04e93 View commit details
    Browse the repository at this point in the history

  2. linter 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    640b96f View commit details
    Browse the repository at this point in the history

  3. remove debug 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    fedaa32 View commit details
    Browse the repository at this point in the history