Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT-#4144: Implement dataframe exchange protocol for pandas storage format #4150

Merged
merged 34 commits into from
Mar 14, 2022

Commits on Mar 3, 2022

  1. FEAT-modin-project#4144: Implement dataframe exchange protocol

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    f144a23 View commit details
    Browse the repository at this point in the history
  2. Fix some dostrings, and some renamings

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    866856a View commit details
    Browse the repository at this point in the history
  3. Move the protocol to lower layer

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    70e2ddf View commit details
    Browse the repository at this point in the history
  4. Implement methods for DataFrame

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    d8aca3f View commit details
    Browse the repository at this point in the history
  5. Move the protocol in df.pandas; impl some column methods

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    db884cd View commit details
    Browse the repository at this point in the history
  6. Some more fixes, impls, moves

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    56b631e View commit details
    Browse the repository at this point in the history
  7. Some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    3ac61a2 View commit details
    Browse the repository at this point in the history
  8. Some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    5bcdfbc View commit details
    Browse the repository at this point in the history
  9. Apply comments

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    88f6d6a View commit details
    Browse the repository at this point in the history
  10. Some fixes taking into account some tests

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    53c5592 View commit details
    Browse the repository at this point in the history
  11. Some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    9232312 View commit details
    Browse the repository at this point in the history
  12. Refactor

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    115bbd9 View commit details
    Browse the repository at this point in the history
  13. Some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    b927b5d View commit details
    Browse the repository at this point in the history
  14. Some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    a71b6c3 View commit details
    Browse the repository at this point in the history
  15. fix comments

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    f11fd7a View commit details
    Browse the repository at this point in the history
  16. Rebase on master and refactor

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    4c938af View commit details
    Browse the repository at this point in the history
  17. Refactor

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    eb6c9aa View commit details
    Browse the repository at this point in the history
  18. Add general tests, some fixes

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    32249bd View commit details
    Browse the repository at this point in the history
  19. Fix lgtm warning

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 3, 2022
    Configuration menu
    Copy the full SHA
    fb1eda3 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2022

  1. Remove from_dataframe impl

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    c79c1ee View commit details
    Browse the repository at this point in the history
  2. Change metadata return value

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    c7477ad View commit details
    Browse the repository at this point in the history
  3. Simplfy new_lengths computation

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    8105e3f View commit details
    Browse the repository at this point in the history
  4. Use DTypeKind directly

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    202300b View commit details
    Browse the repository at this point in the history
  5. Add a comment on pandas.RangeIndex(1) usage

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    4f2bc6e View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2022

  1. Fix metadata for cat dtype

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    60477dd View commit details
    Browse the repository at this point in the history
  2. Return offset that is always equal to 0

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    b2fa39b View commit details
    Browse the repository at this point in the history
  3. Fix describe_categorical

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    86bb363 View commit details
    Browse the repository at this point in the history
  4. Use specific exceptions for unsuitable buffers

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    65fea9e View commit details
    Browse the repository at this point in the history
  5. Fix lgtm warning

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    5e385b8 View commit details
    Browse the repository at this point in the history
  6. Add docstrings for the exceptions

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 5, 2022
    Configuration menu
    Copy the full SHA
    44dfef8 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c6574f7 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2022

  1. Address comments

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 11, 2022
    Configuration menu
    Copy the full SHA
    4ad1703 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2022

  1. Address comments

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 14, 2022
    Configuration menu
    Copy the full SHA
    b3beb79 View commit details
    Browse the repository at this point in the history
  2. Address a comment

    Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
    YarShev committed Mar 14, 2022
    Configuration menu
    Copy the full SHA
    831e8a4 View commit details
    Browse the repository at this point in the history