Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge from master; Resolve conflicts (#4943)
* Scale the system executor provider with the number of pull channels opened. (#4592) Make the SubscriberStubSettings refer to the user provided executor provider instead of a fixed instantiation of it. If the user provides an InstantiatingExecutorProvider instead of a FixedExecutorProvider, this will actually instantiate more than one as the user would expect. It will still only instantiate one for all connections to share, and will do so until the next PR which will make them have different stub instantiations. * Using the google-cloud-http-bom (#4594) * Using the latest version of truth (#4597) * Using a much newer version of truth * Upgrading annotations in google-api-grpc * Regenerate websecurityscanner client (#4614) * Regenerate vision client (#4613) * Regenerate video-intelligence client (#4612) * Regenerate tasks client (#4611) * Regenerate securitycenter client (#4610) * BigQuery: Fix useAvroLogicalTypes option in LoadJobConfiguration And WriteChannelConfiguration. (#4615) * Fix useAvroLogicalTypes in LoadJobConfiguration * Fix comment and added useAvroLogicalTypes in WriteChannelConfiguration * Fix comment * Fix code format * add propagateTimeout in SpannerExceptionFactory (#4598) - Add a helper method propagateTimeout in SpannerExceptionFactory to easily transform a TimeoutException to a SpannerException. - Propagate ApiExceptions a bit more nicely. * Regenerate scheduler client (#4609) * Regenerate pubsub client (#4608) * Regenerate os-login client (#4607) * Regenerate dlp client (#4603) * Regenerate iamcredentials client (#4605) * Regenerate bigquerystorage client (#4601) * Regenerate dataproc client (#4602) * Regenerate bigquerydatatransfer client (#4600) * Regenerate language client (#4606) * Regenerate firestore client (#4604) * Set the isDirectory flag appropriately (#4616) Set the isDirectory flag appropriately when using the currentDirectory() option * Extract the single message processing functionality from processOutstandingBatches. (#4618) * Upgrading grpc in google-api-grpc (#4593) * Prepare for KMS GA release - upgrade versions to 1.0.0. (#4581) * Adding vision v1p4beta1 (#4584) * Adding vision v1p4beta1 * Updating more pom.xmls * Fixing formatting issues * Clean up MessageDispatcher by changing processOutstandingBatches to explicitly loop instead of while(true) with breaks. There is now only 1 explicit return and 1 runtime error. (#4619) * Release google-cloud-java v0.82.0 (#4621) * Release v0.82.0 * Change KMS versions to 1.0.0. * Remove global synchronization from MessageDispatcher. (#4620) * Remove global synchronization from MessageDispatcher. Now that this uses a LinkedBlockingDeque for batches, this is no longer necessary. * Run code format. * Bump next snapshot (#4623) * Regenerate vision client (#4625) * Regenerate dataproc client (#4634) * Regenerate dialogflow client (#4635) * Regenerate firestore client (#4638) * Regenerate iot client (#4639) * Regenerate monitoring client (#4642) * Regenerate bigtable client (#4631) * Regenerate errorreporting client (#4637) * Regenerate pubsub client (#4643) * Regenerate automl client (#4629) * Regenerate redis client (#4644) * Regenerate bigquerydatatransfer client (#4630) * Regenerate scheduler client (#4645) * Regenerate kms client (#4640) * Regenerate vision client (#4650) * Regenerate websecurityscanner client (#4651) * Regenerate containeranalysis client (#4633) * Regenerate dlp client (#4636) * Regenerate trace client (#4649) * Regenerate spanner client (#4647) * Regenerate logging client (#4641) * Regenerate tasks client (#4648) * Regenerate securitycenter client (#4646) * Bump gax to 1.42.0 (#4624) Also regenerate the Compute client to match the newest version of gax. * Batch dml mainline (#4653) * Cloud Spanner Batch DML implementation and integration tests. (#45) * Fix the file header of the newly added classes. (#46) * Fix RPC interface mismatch after GAPIC migration. * Address review comment. * Fix code format with mvn com.coveo:fmt-maven-plugin:format. * Update year in file headers. * BigQuery: add long term storage bytes to standard table definition. (#4387) * BigQuery: Add long term storage bytes for managed tables. * formatting * let maven format the things * plumb this upwards into Table/TableInfo * return * assertion mismatch * Update TableInfoTest.java * Regenerate compute client (#4662) * Add Cloud Security Center v1 API. (#4659) * Add Cloud Security Center v1 API. * Add securitycenter to google-cloud-bom pom.xml * Fixing code format * Adding FieldValue.increment() (#4018) * DO NOT MERGE: Adding FieldValue.increment() * Use "increment" Proto naming * Spanner: Throw exception when SSLHandshakeException occurs instead of infinite retry loop (#4663) * #3889 throw exception when an SSLHandshakeException occurs SSLHandshakeExceptions are not retryable, as it is most probably an indication that the client does not accept the server certificate. * #3889 added test for retryability of SSLHandshakeException * fixed formatting * Add Cloud Scheduler v1 API. (#4658) * Add Cloud Scheduler v1 API. * Fixes to google-cloud-bom pom.xml * Add proto to scheduler pom.xml * Fix Timestamp.parseTimestamp. (#4656) * Fix parseTimestamp docs * Fix timestamp without timezone offset * Fix test cases related to timestamp.parseTimestamp * added test case * Fix timestampParser and added ZoneOffset in timestampParser * Release google-cloud-java v0.83.0 (#4665) * Regenerate securitycenter client (#4667) * Bump next snapshot (#4666) * Change each StreamingSubscriberConnection to have its own executor by default. (#4622) * Change each StreamingSubscriberConnection to have its own executor by default. This increases throughput by reducing contention on the executor queue mutex and makes the Subscriber implementation more accurately reflect the users intent when an InstantiatingExecutorProvider is passed. * Add a comment for executorProvider and alarmsExecutor. * Bigtable: Remove reference to deprecated typesafe name (#4671) * Add Cloud Video Intelligence v1p3beta1 API. (#4669) * Add Cloud Video Intelligence v1p3beta1 API. * Fix code formatting. * Regenerate language client (#4676) * Regenerate securitycenter client (#4677) * Regenerate firestore client (#4686) * #4685 Spanner now extends AutoCloseable (#4687) * Update speech readme to point to v1 javadoc. (#4693) * Fix pendingWrite race condition (#4696) pendingWrites.add() was not guaranteed to be called before pendingWrites.remove() * Optimize pendingWrites (#4697) Reduce contention on pendingWrites by using a ConcurrentHashMap instead. * Better explain how to use explicit credentials (#4694) * Better explain how to use explicit credentials This pull request updates the documentation and adds an example. * Run auto-formatter mvn com.coveo:fmt-maven-plugin:format * Updating Copyright year on UseExplicitCredentials * Add Cloud Talent Solution API. (#4699) * Add Talent API * Add Talent API * Add Talent API * Add talent API * reformat * Update pom.xml * Update pom.xml * Add MDC support in Logback appender (#4477) * Firestore: Update CustomClassMapper (#4675) * Firestore: Update CustomClassMapper * Adding Unit tests * Lint fix * Regenerate securitycenter client (#4704) * Regenerate talent client (#4705) * BigQuery: Added missing partitioned fields to listTables. (#4701) * Add missing partitioned fields to listTables * Fix table delete in finally block * Fix test failing * OpenCensus Support for Cloud Pub/Sub (#4240) * Adds OpenCensus context propagation to Publisher and Subscriber. * Updates OpenCensus attribute keys so that they will be propagated by CPS. * Addresses reviewer comments by fixing build files and using only defined annotations. * Updates build dependencies and copyright date. * Fixes typo. * Removes encoding of OpenCensus tags. Will re-enable once text encoding spec has been finalized (census-instrumentation/opencensus-specs#65). * Updates encoding of SpanContext to use W3C specified encoding; Also preserves sampling decision from the publisher in the subscriber. * Adds unit test for OpenCensusUtil. * Adds unit test for OpenCensusUtil. * Updates OpenCensus integration to use a generic MessageTransform. * Removes now-unused private constant. * Update pom.xml * Marking setTransform as BetaApi * Fixes for formatting issues. * Release v0.84.0 (#4713) * Bump next snapshot (#4715) * Fix comment in grpc-google-cloud-firestore-v1 POM (#4717) Fixing a copy&paste typo * Regenerate firestore client (#4719) * Upgrade common protos dependency to 1.15.0. (#4722) * V1 Admin API for Firestore (#4716) * Manually regenerate Redis (#4723) * Manually regenerate Redis * Fixing a formatting issue * 1.x is stable (#4724) @sduskis * Regenerate bigquerystorage client (#4730) * Regenerate pubsub client (#4732) * Added feature to accept Firestore Value. (#4709) * Fix firestore value * Added IT test * try to fix flaky test (#4733) (cherry picked from commit 8255a9b) * Regenerate compute client (#4731) * Replacing GoogleCloudPlatform with googleapis in docs. (#4707) * Replacing GoogleCloudPlatform with googleapis in docs. * Fixing formatting issues. * Regenerate Redis client (#4738) * redis changes with googleapis changes for STATIC_TYPES * foo * revert noop * fix default value of maxSessions in document of setMaxSessions (#4728) * Spanner: Added extra documentation to the DatabaseClient.singleUse methods (#4721) * added extra documentation to the singleUse methods #4212 * changed formatting manually and re-run mvn formatter * Regenerate Firestore clients (#4741) * add diff * linter * Regenerate iamcredentials client (#4746) * Regenerate monitoring client (#4747) * Refresh Monitoring client (#4744) * regen monitoring with STATIC_TYPES * regen again but with java_package * regen again with enable_string_formatting_functions * regen again * the OuterClass is generated because the proto file contains the amessage of the same name * no changes in protos or gapics, just refresh * refresh but with proto changes only * Add Snippets for working with Assets in Cloud Security Command Center. (#4690) * Add Snippets for working with Assets in Cloud Security Command Center. - I missed instruction for how to add a new key, but I believe a new account is needed, so prestaged assets can be queried. * Address code review comments. * remove securitycenter-it.cfg * update comments * fix string remove firewall reference * Fix format * fix format * Address comments and fix bad docs/alignment with python example * Fix print description * Updates per rubrics * fix warnings * Add Apache Headers * remove unused comment * Manually regenerating the talent v4beta1 API (#4750) * Manually regenerating the talent v4beta1 API ResumeService was removed from the protos, requiring manual deletion of all related classes. * Fixing formatting. * Pass through header provider in BQ storage client settings. (#4740) * Pass through header provider in BQ storage client settings. This change modifies the enhanced stub for the BigQuery storage client to pass through the user-specified header provider to the storage settings base class at creationt ime. This addresses an issue where user-specified headers were being ignored when creating a client object. * Apply formatting plugin * Set up the in-proc server only once * It's 2019 now * changes for iamcreds with STATIC_TYPES (#4745) * Regenerate asset client (#4758) * Regenerate automl client (#4759) * Regenerate dlp client (#4765) * Regenerate bigtable client (#4760) * Regenerate logging client (#4769) * Regenerate monitoring client (#4770) * Regenerate pubsub client (#4772) * Regenerate container client (#4761) * Regenerate os-login client (#4771) * Regenerate errorreporting client (#4766) * Regenerate containeranalysis client (#4762) * Regenerate talent client (#4777) * Regenerate securitycenter client (#4775) * Regenerate redis client (#4773) * Regenerate scheduler client (#4774) * Regenerate iamcredentials client (#4768) * Regenerate dialogflow client (#4764) * Regenerate firestore client (#4767) * Regenerate spanner client (#4776) * Regenerate trace client (#4778) * Regenerate dataproc client (#4763) * Regenerate vision client (#4779) * Regenerate websecurityscanner client (#4780) * regen (#4755) * Upgrade google.auth.version to 0.15.0. (#4743) * Upgrade google.auth.version to 0.14.0. * Upgrade google.auth.version to 0.14.0. * Upgrade google.auth.version to 0.15.0. * allow specifying a custom credentials file for integration tests (#4782) * Regenerate containeranalysis client (#4792) * Regenerate dataproc client (#4793) * Regenerate datastore client (#4794) * Regenerate asset client (#4786) * Regenerate iamcredentials client (#4799) * Regenerate bigquerydatatransfer client (#4788) * Regenerate language client (#4802) * Regenerate kms client (#4801) * Regenerate bigtable client (#4790) * Regenerate monitoring client (#4804) * Regenerate bigquerystorage client (#4789) * Regenerate speech client (#4811) * Regenerate securitycenter client (#4809) * Regenerate spanner client (#4810) * Regenerate redis client (#4807) * Regenerate container client (#4791) * Regenerate scheduler client (#4808) * Regenerate os-login client (#4805) * Regenerate errorreporting client (#4797) * Regenerate websecurityscanner client (#4818) * Regenerate logging client (#4803) * Regenerate texttospeech client (#4814) * Regenerate tasks client (#4813) * Regenerate dialogflow client (#4795) * Regenerate trace client (#4815) * Upgrade protobuf version to 3.7.0. (#4819) * Upgrade protobuf version to 3.7.0. * Upgrade protobuf version to 3.7.1. * Upgrade protobuf version to 3.7.0. * Release google-cloud-java v0.85.0 (#4820) * Bump snapshot (#4821) * Regenerate automl client (#4822) * Regenerate dialogflow client (#4823) * Regenerate dlp client (#4824) * Regenerate firestore client (#4825) * Regenerate iot client (#4826) * Regenerate pubsub client (#4827) * Regenerate talent client (#4828) * Regenerate video-intelligence client (#4829) * Regenerate vision client (#4830) * Add Cloud Asset v1 API. (#4834) * Upgrade gax to 1.43.0. (#4836) * Upgrade gax to 1.43.0. * code format * Regenerate iamcredentials client (#4849) * Regenerate iot client (#4850) * Regenerate kms client (#4851) * Regenerate texttospeech client (#4864) * Regenerate tasks client (#4863) * Regenerate talent client (#4862) * Regenerate bigquerystorage client (#4840) * Regenerate bigquerydatatransfer client (#4839) * Regenerate automl client (#4838) * Regenerate language client (#4852) * Regenerate monitoring client (#4854) * Regenerate pubsub client (#4856) * Regenerate redis client (#4857) * Regenerate scheduler client (#4858) * Regenerate securitycenter client (#4859) * Regenerate spanner client (#4860) * Regenerate trace client (#4865) * Regenerate video-intelligence client (#4866) * Regenerate websecurityscanner client (#4868) * Regenerate vision client (#4867) * Regenerate speech client (#4861) * Regenerate os-login client (#4855) * Regenerate logging client (#4853) * Regenerate firestore client (#4848) * Regenerate containeranalysis client (#4843) * Regenerate container client (#4842) * Regenerate bigtable client (#4841) * Regenerate dataproc client (#4844) * Regenerate dlp client (#4846) * Regenerate errorreporting client (#4847) * google-cloud-logging-logback: Allow user to specify custom LoggingOptions (#4729) google-cloud-logging-logback: #3215 allow user to specify custom LoggingOptions * Regenerate asset client (#4837) * Regenerate dialogflow client (#4845) * Add translate v3beta1 API. (#4870) * translate v3beta1 * readme * Adding datalabeling. (#4872) * Adding datalabeling. * Fixing formatting. * Adding datalabeling readme. * Fixing Readme. * Add tasks v2 client (#4879) * auto close input stream (#4878) * Add Cloud Web Risk client. (#4881) * Add Cloud Web Risk client. * code format fix * Add note on whitelist / signing up for Beta. * Delete stray preposition * Regenerate datalabeling client (#4883) * Regenerate automl client (#4882) * Regenerate talent client (#4884) * fix flaky TransactionManager tests (#4897) Transactions can always be aborted by Cloud Spanner, and all transaction code should therefore be surrounded by with abort safeguarding. * Change .yaml file name for webrisk client. (#4898) * Adding the translate beta samples (#4880) * Adding the translate beta samples * Fixing lint issues * Fixing coding format/style * Fixing coding format/style * Release v0.86.0 (#4899) * Bump next snapshot (#4900) * Regenerate bigquerystorage client (#4902) * Regenerate language client (#4903) * Regenerate webrisk client (#4904) * Storage: Add V4 signing support (#4692) * Add support for V4 signing * (storage) WIP: Add V4 signing support * (storage) Add V4 signing support * Add V4 samples (#4753) * storage: fix v4 samples (#4754) * Add V4 samples * Match C++ samples * Add missing import * Add web risk to list of clients. (#4901) * Release v0.87.0 (#4907) * Bump next snapshot (#4908) * Regenerate tasks client (#4912) * Regenerate scheduler client (#4911) * Regenerate redis client (#4910) * Regenerate compute client (#4909) * Spanner: Refactor SpannerImpl - Move AbstractResultSet to separate file (#4891) Refactor SpannerImpl: Move AbstractResultSet to separate file * Spanner: Refactor SpannerImpl - Move AbstractReadContext to separate file (#4890) Spanner: Refactor SpannerImpl - Move AbstractReadContext to separate file * Regenerate language client (#4921) * Spanner: Refactor SpannerImpl - Move DatabaseAdminClientImpl to separate file (#4892) * refactor SpannerImpl: move DatabaseAdminClientImpl to separate file * removed unnecessary imports * Bigquery : Fix close write channel (#4924) * close write channel * Update BigQuerySnippets.java * Update BigQuerySnippets.java * Update BigQuerySnippets.java * Spanner: Refactor SpannerImpl - Move InstanceAdminClient to separate file (#4893) refactor SpannerImpl: move InstanceAdminClient to separate file * refactor SpannerImpl: move PartitionedDmlTransaction to separate file (#4894) * BigQuery: Added listPartitions. (#4923) * added listPartitions * added unit test * modified code * modified unit test for listPartitions * added integration test * Fix table name * Fix integration test * Regenerate dialogflow client (#4928) * Regenerate securitycenter client (#4929) * Regenerate trace client (#4931) * google-cloud-core: Optimize Date.parseDate(String) (#4920) * optimized date parsing Date parsing using a regular expression is slower than a specific implementation for the only format that is supported. * removed IntParser and added test cases * check for invalid date/year/month/day * Spanner: Refactor SpannerImpl - Move TransactionRunnerImpl to separate file (#4896) refactor SpannerImpl: move TransactionRunnerImpl to separate file * Regenerate securitycenter client (#4937) * storage: Un-Ignore testRotateFromCustomerEncryptionToKmsKeyWithCustomerEncryption (#4936) * Adding support to custom ports on LocalDatastoreHelper (#4933) (#4935) * Storage : Fix manage resumeable signedURL uploads. (#4874) * commit for manage resumeable signedURL uploads #2462 * for manage resumeable signedURL uploads #2462 * fix comment * fix ITStorageTest case written for upload using signURL * fix format * fix BlobWriteChannel constructor changes. * fix signURL validation. * fix format * signurl rename to signedURL , firstnonnull check removed,signedURL validation with googleacessid and expires field also. * signedURL validation with googleacessid and expires field also. * fix forsignedURL validation with V4 Signing support. * fix forproviding example of writing content using signedURL through Writer. * fix forStorageRpc open method argument change. * fix forStorageRpc open method doc comment changes. * cloud-storage-contrib-nio: Add support for newFileChannel (#4718) add support for newFileChannel(...) * Change MessageDispatcher to be synchronous instead of asynchronous. (#4916) * Change MessageDispatcher to be synchronous instead of asynchronous. This removes the failure mode described in #2452 that can occur when MaxOutstandingElementCount is low and there is more than one connection. In this case, it is possible for an individual MessageDispatcher to have no outstanding in-flight messages, but also be blocked by flow control with a whole new batch outstanding. In this case, it will never make progress on that batch since it will never receive another batch and the queue was made to not be shared in #4590, so the batch will never be pulled off by another MessageDispatcher. By changing this to use a blocking flow controller, this will never happen, as each batch will synchronously wait until it is allowed by flow control before being processed. * Run mvn com.coveo:fmt-maven-plugin:format * Remove unused code
- Loading branch information
1 parent
858d4e9
commit c2c8b5c