Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQuery Storage: Add sharding strategy, stream splitting, Arrow support (via synth). #8477

Merged
merged 1 commit into from
Jun 27, 2019

Conversation

yoshi-automation
Copy link
Contributor

This PR was generated using Autosynth. 🌈

Here's the log from Synthtool:

synthtool > Executing /tmpfs/src/git/autosynth/working_repo/bigquery_storage/synth.py.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:b79c8c20ee51e5302686c9d1294672d59290df1489be93749ef17d0172cc508d
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/bigquery/storage/artman_bigquerystorage_v1beta1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/bigquery/storage/v1beta1/avro.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto/avro.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/bigquery/storage/v1beta1/table_reference.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto/table_reference.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/bigquery/storage/v1beta1/arrow.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto/arrow.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/bigquery/storage/v1beta1/storage.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto/storage.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/bigquery/storage/v1beta1/read_options.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto/read_options.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/bigquerystorage-v1beta1/google/cloud/bigquery_storage_v1beta1/proto.
synthtool > Replaced 'from google.cloud.bigquery.storage_v1beta1.proto' in google/cloud/bigquery_storage_v1beta1/proto/storage_pb2.py.
synthtool > Replaced 'from google.cloud.bigquery.storage_v1beta1.proto' in google/cloud/bigquery_storage_v1beta1/proto/storage_pb2_grpc.py.
synthtool > Replaced 'google-cloud-bigquerystorage' in google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py.
synthtool > Replaced 'import google.api_core.gapic_v1.method\n' in google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py.
synthtool > Replaced 'from google.cloud import bigquery_storage_v1beta1' in tests/unit/gapic/v1beta1/test_big_query_storage_client_v1beta1.py.
synthtool > Replaced 'bigquery_storage_v1beta1.BigQueryStorageClient' in tests/unit/gapic/v1beta1/test_big_query_storage_client_v1beta1.py.
synthtool > Replaced 'return google.api_core.grpc_helpers.create_channel\\(\n(\\s+)address,\n\\s+credentials=.*,\n\\s+scopes=.*,\n' in google/cloud/bigquery_storage_v1beta1/gapic/transports/big_query_storage_grpc_transport.py.
synthtool > Replaced 'if transport:' in google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py.
synthtool > No replacements made in ['google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py'] for pattern to_grpc_metadata\(\n, maybe replacement is not longer needed?
synthtool > Replaced 'metadata.append\\(routing_metadata\\)' in google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py.
synthtool > Replaced 'if channel is not None and credentials is not None:' in google/cloud/bigquery_storage_v1beta1/gapic/transports/big_query_storage_grpc_transport.py.
synthtool > Replaced 'if channel is None:' in google/cloud/bigquery_storage_v1beta1/gapic/transports/big_query_storage_grpc_transport.py.
synthtool > Replaced 'google.api_core.grpc_helpers.create_channel\\(' in google/cloud/bigquery_storage_v1beta1/gapic/transports/big_query_storage_grpc_transport.py.
Running session blacken
Creating virtualenv using python3.6 in .nox/blacken
pip install black
black google tests docs
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/gapic/enums.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/arrow_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/gapic/transports/big_query_storage_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/avro_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/avro_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/read_options_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/arrow_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/read_options_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/table_reference_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/table_reference_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/storage_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/types.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/tests/unit/gapic/v1beta1/test_big_query_storage_client_v1beta1.py
reformatted /tmpfs/src/git/autosynth/working_repo/bigquery_storage/google/cloud/bigquery_storage_v1beta1/proto/storage_pb2.py
All done! ✨ 🍰 ✨
19 files reformatted, 12 files left unchanged.
Session blacken was successful.
synthtool > Cleaned up 0 temporary directories.
synthtool > Wrote metadata to synth.metadata.

@yoshi-automation yoshi-automation requested a review from a team June 26, 2019 12:12
@yoshi-automation yoshi-automation added the api: bigquerystorage Issues related to the BigQuery Storage API. label Jun 26, 2019
@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Jun 26, 2019
@tseaver tseaver changed the title [CHANGE ME] Re-generated bigquery_storage to pick up changes in the API or client library generator. BigQuery Storage: Add sharding strategy, stream splitting, Arrow support (via synth). Jun 26, 2019
@tswast
Copy link
Contributor

tswast commented Jun 27, 2019

FYI: @TheNeuralBit

@tswast tswast merged commit 3d32438 into master Jun 27, 2019
@TheNeuralBit
Copy link
Contributor

👍 thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquerystorage Issues related to the BigQuery Storage API. cla: yes This human has signed the Contributor License Agreement. codegen
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants