Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

POC: ArrayManager -- array-based data manager for columnar store #36010

Merged
merged 42 commits into from
Jan 13, 2021
Merged

POC: ArrayManager -- array-based data manager for columnar store #36010

merged 42 commits into from
Jan 13, 2021

Commits on Sep 4, 2020

  1. POC: ArrayManager -- array-based data manager for columnar store

    @jorisvandenbossche
    jorisvandenbossche committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    a51835b View commit details
    Browse the repository at this point in the history

  2. Update with latest master + some fixes

    @jorisvandenbossche
    jorisvandenbossche committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    591579b View commit details
    Browse the repository at this point in the history

  3. add pd.options.mode.data_manager to switch

    @jorisvandenbossche
    jorisvandenbossche committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    896080a View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    f9c4dda View commit details
    Browse the repository at this point in the history

  2. add apply_with_block workaround

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    d18082a View commit details
    Browse the repository at this point in the history

  3. fix alignment in apply

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    cf3c07a View commit details
    Browse the repository at this point in the history

  4. reorder methods to match BlockManager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    b252c6d View commit details
    Browse the repository at this point in the history

  5. skip json tests for now

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    0fb645e View commit details
    Browse the repository at this point in the history

  6. skip more json tests + to_csv with to_native_types

    @jorisvandenbossche
    jorisvandenbossche committed Sep 5, 2020
    Configuration menu
    Copy the full SHA
    eb55fef View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 6, 2020
    Configuration menu
    Copy the full SHA
    d241f31 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2020

  1. support both ndarrays and ExtensionArrays

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    47c3ee3 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    75f7de2 View commit details
    Browse the repository at this point in the history

  3. add unstack

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    f36e395 View commit details
    Browse the repository at this point in the history

  4. fix native types, skip quantile, hdf, stata tests

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    be20816 View commit details
    Browse the repository at this point in the history

  5. remove skip in the benchmarks

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    8b7cc81 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    a239f50 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Sep 22, 2020
    Configuration menu
    Copy the full SHA
    a0ccf9a View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Oct 16, 2020
    Configuration menu
    Copy the full SHA
    dc1b190 View commit details
    Browse the repository at this point in the history

  2. remove manager keyword from DataFrame constructor, add _as_manager in… 

    …stead
    @jorisvandenbossche
    jorisvandenbossche committed Oct 16, 2020
    Configuration menu
    Copy the full SHA
    55d38be View commit details
    Browse the repository at this point in the history

  3. move new ArrayManager code to separate file

    @jorisvandenbossche
    jorisvandenbossche committed Oct 16, 2020
    Configuration menu
    Copy the full SHA
    3dea0d7 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2020

  1. Merge branch 'master' of https://github.com/pandas-dev/pandas into ar… 

    …ray-manager
    @jbrockmendel
    jbrockmendel committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    1a61333 View commit details
    Browse the repository at this point in the history

  2. de-privatize

    @jbrockmendel
    jbrockmendel committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    9751d33 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    e45b645 View commit details
    Browse the repository at this point in the history

  2. try fix up typing

    @jorisvandenbossche
    jorisvandenbossche committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    3749c7d View commit details
    Browse the repository at this point in the history

  3. add pytest option + add one github actions build to run them

    @jorisvandenbossche
    jorisvandenbossche committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    af53040 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2020

  1. fix pytest marks for skipping when using array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    cc45673 View commit details
    Browse the repository at this point in the history

  2. several fixes - get tests/frame/methods tests passing

    @jorisvandenbossche
    jorisvandenbossche committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    27cf215 View commit details
    Browse the repository at this point in the history

  3. ci - only run the tests/frame/methods tests

    @jorisvandenbossche
    jorisvandenbossche committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    f6a97df View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    67c4c2b View commit details
    Browse the repository at this point in the history

  5. mypy fix

    @jorisvandenbossche
    jorisvandenbossche committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    670ed76 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2020

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    5128ad1 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2021

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    5c73688 View commit details
    Browse the repository at this point in the history

  2. move to internals/construction.py

    @jorisvandenbossche
    jorisvandenbossche committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    a9a8c2d View commit details
    Browse the repository at this point in the history

  3. update for latest changes - fix tests/mypy

    @jorisvandenbossche
    jorisvandenbossche committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    c7898fb View commit details
    Browse the repository at this point in the history

  4. fix todo

    @jorisvandenbossche
    jorisvandenbossche committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    3430307 View commit details
    Browse the repository at this point in the history

  5. fix import in tests

    @jorisvandenbossche
    jorisvandenbossche committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    1a30013 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2021

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Jan 10, 2021
    Configuration menu
    Copy the full SHA
    ef86b1e View commit details
    Browse the repository at this point in the history

  2. add union alias to typing

    @jorisvandenbossche
    jorisvandenbossche committed Jan 10, 2021
    Configuration menu
    Copy the full SHA
    c5548d9 View commit details
    Browse the repository at this point in the history

  3. updates based on review

    @jorisvandenbossche
    jorisvandenbossche committed Jan 10, 2021
    Configuration menu
    Copy the full SHA
    afe8f80 View commit details
    Browse the repository at this point in the history

  4. skip json tests to avoid segfaults

    @jorisvandenbossche
    jorisvandenbossche committed Jan 10, 2021
    Configuration menu
    Copy the full SHA
    b88c757 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2021

  1. Merge remote-tracking branch 'upstream/master' into array-manager

    @jorisvandenbossche
    jorisvandenbossche committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    ddc51d0 View commit details
    Browse the repository at this point in the history

  2. fix for Label -> Hashable change in master

    @jorisvandenbossche
    jorisvandenbossche committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    9dc5600 View commit details
    Browse the repository at this point in the history