Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Data] Make sure num_gpus provide to Ray Data is appropriately passed to ray.remote call #47768

Merged
merged 15 commits into from
Sep 27, 2024
Merged

[Data] Make sure num_gpus provide to Ray Data is appropriately passed to ray.remote call #47768

merged 15 commits into from
Sep 27, 2024

Commits on Sep 20, 2024

  1. Fixed cached_remote_fn to avoid mixing up Ray's remote method insta… 

    …ntiation for callers providing different arguments sets

Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    bece986 View commit details
    Browse the repository at this point in the history

  2. Make arg-list hashable 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    753be40 View commit details
    Browse the repository at this point in the history

  3. Added test 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    b4b30f0 View commit details
    Browse the repository at this point in the history

  4. Pass in static Ray remote args for mapping tasks 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    6c67e74 View commit details
    Browse the repository at this point in the history

  5. lint 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    22955fc View commit details
    Browse the repository at this point in the history

  6. Tidying up 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    e2b53bc View commit details
    Browse the repository at this point in the history

  7. Added E2E test 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    53a5d83 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Fixing NPE 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    30100ff View commit details
    Browse the repository at this point in the history

  2. Tidying up 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    18b4447 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Generalized conversion to make_hashable utility 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    94621b5 View commit details
    Browse the repository at this point in the history

  2. Added tests 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5d42ebb View commit details
    Browse the repository at this point in the history

  3. lint 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    17bdc08 View commit details
    Browse the repository at this point in the history

  4. Add support for more generic Hashable args 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    277e0a0 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Use appropriately initialized base field 

    Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    4711bfe View commit details
    Browse the repository at this point in the history

  2. Fixed operator fusion to properly handle scheduling_strategy; 

    Fixed tests

Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
    @alexeykudinkin
    alexeykudinkin committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    65a1b28 View commit details
    Browse the repository at this point in the history