Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BigQuery Storage: Add support for arrow format in BQ Read API #8644

Merged
merged 10 commits into from
Jul 11, 2019
Merged

BigQuery Storage: Add support for arrow format in BQ Read API #8644

merged 10 commits into from
Jul 11, 2019

Commits on Jul 1, 2019

  1. BQ Storage: Add basic arrow stream parser

    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    9553d8d View commit details
    Browse the repository at this point in the history

  2. BQ Storage: Add tests for to_dataframe with arrow data

    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    4873562 View commit details
    Browse the repository at this point in the history

  3. Use Arrow format in client.list_rows(..).to_dataframe(..) with BQ Sto… 

    …rage client
    @TheNeuralBit
    TheNeuralBit committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    45bd1e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2019

  1. Merge remote-tracking branch 'upstream/master' into bq-storage-arrow

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    552fc1e View commit details
    Browse the repository at this point in the history

  2. Add system test for arrow wire format.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    06f990e View commit details
    Browse the repository at this point in the history

  3. Add pyarrow to system tests deps.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    5e7a403 View commit details
    Browse the repository at this point in the history

  4. Add to_arrow with BQ Storage API.

    @tswast
    tswast committed Jul 10, 2019
    Configuration menu
    Copy the full SHA
    5155ac9 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2019

  1. Revert changes to bigquery so that bigquery_storage can be released 

    separately.
    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    5a5edd5 View commit details
    Browse the repository at this point in the history

  2. Add tests for to_arrow.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    4986bd1 View commit details
    Browse the repository at this point in the history

  3. Remove parameterized error messages.

    @tswast
    tswast committed Jul 11, 2019
    Configuration menu
    Copy the full SHA
    f647062 View commit details
    Browse the repository at this point in the history