Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT-#4419: Extend virtual partitioning API to pandas on Dask #4420

Merged
merged 30 commits into from
Jul 12, 2022
Merged

FEAT-#4419: Extend virtual partitioning API to pandas on Dask #4420

merged 30 commits into from
Jul 12, 2022

Commits on Apr 25, 2022

  1. FEAT-modin-project#4419: Extend virtual partitioning API to pandas on… 

    … Dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    28cdc19 View commit details
    Browse the repository at this point in the history

  2. Format code 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    15b0072 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. Fix list_of_blocks add list_of_ips 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    ae4eb6c View commit details
    Browse the repository at this point in the history

  2. Fix documentation 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    026bd14 View commit details
    Browse the repository at this point in the history

  3. Fix docs 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    fa377a8 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2022

  1. Update modin/core/execution/dask/implementations/pandas_on_dask/parti… 

    …tioning/virtual_partition.py

Co-authored-by: Mahesh Vashishtha <mvashishtha@users.noreply.github.com>
    @RehanSD @mvashishtha
    RehanSD and mvashishtha authored May 2, 2022
    Configuration menu
    Copy the full SHA
    b9d68f7 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2022

  1. Merge remote-tracking branch 'upstream/master' into rehan/virtual_par… 

    …titioning_dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    17a9c65 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Merge remote-tracking branch 'upstream/master' into rehan/virtual_par… 

    …titioning_dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    348272d View commit details
    Browse the repository at this point in the history

  2. Add comments to virtual partition, and update drain call queue to acc… 

    …ept num_splits argument

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    6784b4b View commit details
    Browse the repository at this point in the history

  3. lint 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    4efd83b View commit details
    Browse the repository at this point in the history

  4. copy rebalance_partitions implementation to dask virtual partitions 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    af4edbc View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2022

  1. Fix rebalance_partitions, update groupby test, and add test for virtu… 

    …al partitioning API

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    0ac6de3 View commit details
    Browse the repository at this point in the history

  2. Add name to release notes 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    8c44eb1 View commit details
    Browse the repository at this point in the history

  3. lint 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    a5af1ff View commit details
    Browse the repository at this point in the history

  4. Refactor to reduce code redundancy 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    971e00a View commit details
    Browse the repository at this point in the history

  5. fix docs 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    87cad7c View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Co-authored-by: Mahesh Vashishtha <mvashishtha@users.noreply.github.com>
    @RehanSD @mvashishtha
    RehanSD and mvashishtha authored Jun 16, 2022
    Configuration menu
    Copy the full SHA
    0de19cd View commit details
    Browse the repository at this point in the history

  7. update tests 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    4f5dd50 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'rehan/virtual_partitioning_dask' of https://github.com/… 

    …RehanSD/modin into rehan/virtual_partitioning_dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    f5d3eb1 View commit details
    Browse the repository at this point in the history

  9. Fix typo in tests 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    5e748cd View commit details
    Browse the repository at this point in the history

  10. Add more comprehensive test 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    0cc25c4 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2022

  1. Merge remote-tracking branch 'upstream/master' into rehan/virtual_par… 

    …titioning_dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    43296b2 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2022

  1. Resolve col width issue 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 19, 2022
    Configuration menu
    Copy the full SHA
    66c4360 View commit details
    Browse the repository at this point in the history

  2. lint 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 19, 2022
    Configuration menu
    Copy the full SHA
    9f48f0d View commit details
    Browse the repository at this point in the history

  3. flake8 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 19, 2022
    Configuration menu
    Copy the full SHA
    8dab0d1 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2022

  1. Resolve col width issue without hurting perf 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    2d9f150 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. Move concat into testr 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    9a945e8 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. Address review comments 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    5b322ee View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into rehan/virtual_par… 

    …titioning_dask

Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    a761182 View commit details
    Browse the repository at this point in the history

  3. fix typos 

    Signed-off-by: Rehan Durrani <rehan@ponder.io>
    @RehanSD
    RehanSD committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    6a9855c View commit details
    Browse the repository at this point in the history