Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BigQuery: Add support for BigQuery Storage API Arrow format in to_dataframe and to_arrow. #8551

Merged
merged 20 commits into from
Jul 12, 2019
Merged

BigQuery: Add support for BigQuery Storage API Arrow format in to_dataframe and to_arrow. #8551

merged 20 commits into from
Jul 12, 2019

Commits on Jul 1, 2019

  1. BQ Storage: Add basic arrow stream parser

    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    9553d8d View commit details
    Browse the repository at this point in the history

  2. BQ Storage: Add tests for to_dataframe with arrow data

    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    4873562 View commit details
    Browse the repository at this point in the history

  3. Use Arrow format in client.list_rows(..).to_dataframe(..) with BQ Sto… 

    …rage client
    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    45bd1e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2019

  1. Merge remote-tracking branch 'upstream/master' into bq-storage-arrow

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    552fc1e View commit details
    Browse the repository at this point in the history

  2. Add system test for arrow wire format.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    06f990e View commit details
    Browse the repository at this point in the history

  3. Add pyarrow to system tests deps.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    5e7a403 View commit details
    Browse the repository at this point in the history

  4. Add to_arrow with BQ Storage API.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    5155ac9 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2019

  1. Revert changes to bigquery so that bigquery_storage can be released 

    separately.
    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    5a5edd5 View commit details
    Browse the repository at this point in the history

  2. Add tests for to_arrow.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    4986bd1 View commit details
    Browse the repository at this point in the history

  3. Revert "Revert changes to bigquery so that bigquery_storage can be re… 

    …leased"

This reverts commit 5a5edd5.
    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    c2cc2b6 View commit details
    Browse the repository at this point in the history

  4. Add system test for to_arrow.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    c18c21e View commit details
    Browse the repository at this point in the history

  5. Remove parameterized error messages.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    f647062 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'pr8551-only-bqstorage' into bq-storage-arrow

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    05cfac8 View commit details
    Browse the repository at this point in the history

  7. Avoid single-field record types in system tests.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    526ac19 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'upstream/master' into bq-storage-arrow

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    e1c0526 View commit details
    Browse the repository at this point in the history

  9. Bump minimum google-cloud-bigquery-storage.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    9091cdc View commit details
    Browse the repository at this point in the history

  10. Blacken

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    0ef0625 View commit details
    Browse the repository at this point in the history

  11. Add tests for to_arrow.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    2e1a46d View commit details
    Browse the repository at this point in the history

  12. Exclude bad pyarrow release.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    46f1fab View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2019

  1. Set streams in mock session.

    @tswast
    tswast committed Jul 12, 2019
    Configuration menu
    Copy the full SHA
    a88690e View commit details
    Browse the repository at this point in the history