Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

More robust None handling #3195

Merged
merged 38 commits into from
Dec 9, 2021
Merged

More robust None handling #3195

merged 38 commits into from
Dec 9, 2021

Commits on Oct 30, 2021

  1. Make features nullable

    @mariosasko
    mariosasko committed Oct 30, 2021
    Configuration menu
    Copy the full SHA
    3bf068c View commit details
    Browse the repository at this point in the history

  2. Allow None in class_encode_column

    @mariosasko
    mariosasko committed Oct 30, 2021
    Configuration menu
    Copy the full SHA
    7384951 View commit details
    Browse the repository at this point in the history

  3. Optimize class_encode_column

    @mariosasko
    mariosasko committed Oct 30, 2021
    Configuration menu
    Copy the full SHA
    8b7baa6 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2021

  1. Simplify cast change; update sort

    @mariosasko
    mariosasko committed Oct 31, 2021
    Configuration menu
    Copy the full SHA
    1a6939d View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2021

  1. Fix sort

    @mariosasko
    mariosasko committed Nov 1, 2021
    1 Configuration menu
    Copy the full SHA
    a53de01 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2021

  1. Fix merge conflict

    @mariosasko
    mariosasko committed Nov 13, 2021
    Configuration menu
    Copy the full SHA
    b5ffc12 View commit details
    Browse the repository at this point in the history

  2. Fix merge conflict - part 2

    @mariosasko
    mariosasko committed Nov 13, 2021
    Configuration menu
    Copy the full SHA
    3c64406 View commit details
    Browse the repository at this point in the history

  3. Add option to include Nones in class_encode_column

    @mariosasko
    mariosasko committed Nov 13, 2021
    Configuration menu
    Copy the full SHA
    a1b7278 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2021

  1. Add support for type promotion

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    d3e6b9b View commit details
    Browse the repository at this point in the history

  2. Preserve column order in class_encode_column

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    e185f97 View commit details
    Browse the repository at this point in the history

  3. Add None handling to decoding

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    b6939be View commit details
    Browse the repository at this point in the history

  4. Pandas decoding

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    23235b7 View commit details
    Browse the repository at this point in the history

  5. Style

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    cec9e5e View commit details
    Browse the repository at this point in the history

  6. Small decode refactor

    @mariosasko
    mariosasko committed Nov 15, 2021
    1 Configuration menu
    Copy the full SHA
    10881bd View commit details
    Browse the repository at this point in the history

  7. Style

    @mariosasko
    mariosasko committed Nov 15, 2021
    1 Configuration menu
    Copy the full SHA
    f4a0d3d View commit details
    Browse the repository at this point in the history

  8. Fix class_encode_column

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    133a597 View commit details
    Browse the repository at this point in the history

  9. Fixing failing test - part 1

    @mariosasko
    mariosasko committed Nov 15, 2021
    1 Configuration menu
    Copy the full SHA
    161b7df View commit details
    Browse the repository at this point in the history

  10. Fix update_metadata_with_features in rename_columns

    @mariosasko
    mariosasko committed Nov 15, 2021
    1 Configuration menu
    Copy the full SHA
    5b43053 View commit details
    Browse the repository at this point in the history

  11. Fix apply offset to indices part

    @mariosasko
    mariosasko committed Nov 15, 2021
    1 Configuration menu
    Copy the full SHA
    4a5ad65 View commit details
    Browse the repository at this point in the history

  12. Check for duplicated columns

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    997d928 View commit details
    Browse the repository at this point in the history

  13. Fix error due to duplicated column names

    @mariosasko
    mariosasko committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    6466f74 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2021

  1. Add support for None in ArrayXD types

    @mariosasko
    mariosasko committed Nov 16, 2021
    1 Configuration menu
    Copy the full SHA
    b91b8a4 View commit details
    Browse the repository at this point in the history

  2. Add support for None values in NumPy format for non-ArrayXD types

    @mariosasko
    mariosasko committed Nov 16, 2021
    1 Configuration menu
    Copy the full SHA
    7e2d6d8 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2021

  1. Merge branch 'master' of github.com:huggingface/datasets into fix-3181

    @mariosasko
    mariosasko committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    1b43c5e View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2021

  1. Address comments and additional improvements/refactor

    @mariosasko
    mariosasko committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    b51ace8 View commit details
    Browse the repository at this point in the history

  2. Remove format

    @mariosasko
    mariosasko committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    60b181f View commit details
    Browse the repository at this point in the history

  3. Add tests

    @mariosasko
    mariosasko committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    737e56a View commit details
    Browse the repository at this point in the history

  4. Refactor align_features logic

    @mariosasko
    mariosasko committed Nov 22, 2021
    1 Configuration menu
    Copy the full SHA
    1f1bd59 View commit details
    Browse the repository at this point in the history

  5. Style

    @mariosasko
    mariosasko committed Nov 22, 2021
    1 Configuration menu
    Copy the full SHA
    72710f3 View commit details
    Browse the repository at this point in the history

  6. Allow unsafe cast in add_item

    @mariosasko
    mariosasko committed Nov 22, 2021
    1 Configuration menu
    Copy the full SHA
    b398b7c View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2021

  1. Avoid autocast and log warning

    @mariosasko
    mariosasko committed Nov 25, 2021
    1 Configuration menu
    Copy the full SHA
    4e87b11 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:huggingface/datasets into fix-3181

    @mariosasko
    mariosasko committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    ab8bd00 View commit details
    Browse the repository at this point in the history

  3. Use autocast again (PyArrow does it)

    @mariosasko
    mariosasko committed Nov 25, 2021
    1 Configuration menu
    Copy the full SHA
    9f4248e View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2021

  1. Merge conflict

    @mariosasko
    mariosasko committed Dec 8, 2021
    1 Configuration menu
    Copy the full SHA
    8b0ed15 View commit details
    Browse the repository at this point in the history

  2. Allow None in Image feature

    @mariosasko
    mariosasko committed Dec 8, 2021
    1 Configuration menu
    Copy the full SHA
    5d54ccc View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2021

  1. Remove casts in add_item/concatenate_datasets

    @mariosasko
    mariosasko committed Dec 9, 2021
    1 Configuration menu
    Copy the full SHA
    7636ad6 View commit details
    Browse the repository at this point in the history

  2. Leave cast in add_item

    @mariosasko
    mariosasko committed Dec 9, 2021
    1 Configuration menu
    Copy the full SHA
    86c23cb View commit details
    Browse the repository at this point in the history

  3. Better comment in add_item

    @mariosasko
    mariosasko committed Dec 9, 2021
    1 Configuration menu
    Copy the full SHA
    9f887c6 View commit details
    Browse the repository at this point in the history