Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add empty source handling for delta table format on filesystem destination #1617

Merged
merged 14 commits into from
Aug 1, 2024
Merged

Add empty source handling for delta table format on filesystem destination #1617

merged 14 commits into from
Aug 1, 2024

Commits on Jul 19, 2024

  1. make null column optional in arrow table test case

    @jorritsandbrink
    jorritsandbrink committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    b3511e8 View commit details
    Browse the repository at this point in the history

  2. handle empty source for delta table format

    @jorritsandbrink
    jorritsandbrink committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    e3d8f95 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. upgrade pyarrow and comment lancedb

    @jorritsandbrink
    jorritsandbrink committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    5bbfba4 View commit details
    Browse the repository at this point in the history

  2. use RecordBatchReader for filesystem delta table writes

    @jorritsandbrink
    jorritsandbrink committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    79eb1c1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'devel' of https://github.com/dlt-hub/dlt into fix/1613-… 

    …empty-table-delta-table-formatfilesystem
    @jorritsandbrink
    jorritsandbrink committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    5b8eb24 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. Revert "upgrade pyarrow and comment lancedb" 

    This reverts commit 5bbfba4.
    @jorritsandbrink
    jorritsandbrink committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    c3a9798 View commit details
    Browse the repository at this point in the history

  2. mark tests that need pyarrow version 17

    @jorritsandbrink
    jorritsandbrink committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    9b2035f View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. assert pyarrow version for delta table format on filesystem destination

    @jorritsandbrink
    jorritsandbrink committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    8e026f5 View commit details
    Browse the repository at this point in the history

  2. autoskip tests if pyarrow dependency is not satisfied

    @jorritsandbrink
    jorritsandbrink committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    e8d649a View commit details
    Browse the repository at this point in the history

  3. fix destination config issue

    @jorritsandbrink
    jorritsandbrink committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f6b3709 View commit details
    Browse the repository at this point in the history

  4. add github workflow for needspyarrow17 tests

    @jorritsandbrink
    jorritsandbrink committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    ad5974d View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. fix pyarrow17 github workflow

    @jorritsandbrink
    jorritsandbrink committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    93658b9 View commit details
    Browse the repository at this point in the history

  2. fix local filesystem bucket url

    @jorritsandbrink
    jorritsandbrink committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e54bce3 View commit details
    Browse the repository at this point in the history

  3. fix typo

    @jorritsandbrink
    jorritsandbrink committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    6be8683 View commit details
    Browse the repository at this point in the history