Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement mark_sharding as a custom op to support dynamo spmd activation sharding #5712

Merged
merged 14 commits into from
Nov 11, 2023
Merged

Implement mark_sharding as a custom op to support dynamo spmd activation sharding #5712

merged 14 commits into from
Nov 11, 2023

Commits on Oct 31, 2023

  1. Implement mark_sharding as a custom op to support dynamo spmd activat… 

    …ion sharding
    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    53e7ec0 View commit details
    Browse the repository at this point in the history

  2. Update to include OpSharding as an input

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    f0e8a94 View commit details
    Browse the repository at this point in the history

  3. Rebase with master and run linter

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    7891b42 View commit details
    Browse the repository at this point in the history

  4. Update unit tests

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    6aeeecf View commit details
    Browse the repository at this point in the history

  5. Refine custom marking sharding op

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    dc19b9b View commit details
    Browse the repository at this point in the history

  6. Re-run linter due to wrong version

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    a20d710 View commit details
    Browse the repository at this point in the history

  7. Add new API for custom mark sharding op and update tests

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    bd169c2 View commit details
    Browse the repository at this point in the history

  8. Add torch pin

    @wonjoolee95
    wonjoolee95 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    ae05c9a View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Clean up some code

    @wonjoolee95
    wonjoolee95 committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    08d6296 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Update code to transfer pylist to xla::OpSharding

    @wonjoolee95
    wonjoolee95 committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    9aaa533 View commit details
    Browse the repository at this point in the history

  2. Update unit test and run linter

    @wonjoolee95
    wonjoolee95 committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    a98bfb2 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Address comments -- fix typos and variable names

    @wonjoolee95
    wonjoolee95 committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    a4318a6 View commit details
    Browse the repository at this point in the history

  2. Run linter

    @wonjoolee95
    wonjoolee95 committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    e35ca64 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Add metric assertions to unit tests

    @wonjoolee95
    wonjoolee95 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    ae721ae View commit details
    Browse the repository at this point in the history