Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figure out how to use RetryHelper in insertAll #470

Closed
mziccard opened this issue Dec 16, 2015 · 1 comment
Closed

Figure out how to use RetryHelper in insertAll #470

mziccard opened this issue Dec 16, 2015 · 1 comment
Assignees
Labels
api: bigquery Issues related to the BigQuery API. priority: p2 Moderately-important priority. Fix may not be included in next release. triaged for GA type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@mziccard
Copy link
Contributor

Right now bigquery.insertAll does not use RetryHelper. Retrying a failed insertAll operation might insert duplicates into the table unless an ID is associated to each row.

We have 2 options here:

  1. Use RetryHelper and document that unless row IDs are used, duplicates might be inserted
  2. Use RetryHelper and when retrying add a randomUUID() to all rows that have no ID specified

It is worth noting that BigQuery duplicate detection based on row ID is best effort. Opinions/suggestions are welcome!

/cc @jtigani

@mziccard mziccard added the api: bigquery Issues related to the BigQuery API. label Dec 16, 2015
@mziccard mziccard self-assigned this Dec 16, 2015
@garrettjonesgoogle garrettjonesgoogle added type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. triaged for beta labels Nov 23, 2016
@garrettjonesgoogle garrettjonesgoogle added the priority: p2 Moderately-important priority. Fix may not be included in next release. label Jul 18, 2017
@danoscarmike
Copy link
Contributor

This issue may no longer be relevant due to its age. If you are still experiencing this issue and are reasonably certain that it is a bug, please feel free to re-open this it with enough information to help us reproduce it.

github-actions bot pushed a commit that referenced this issue Jun 23, 2022
…cies to v2.13.0 (#470)

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [com.google.cloud:google-cloud-shared-dependencies](https://github.com/googleapis/java-shared-dependencies) | `2.12.0` -> `2.13.0` | [![age](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-shared-dependencies/2.13.0/age-slim)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-shared-dependencies/2.13.0/adoption-slim)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-shared-dependencies/2.13.0/compatibility-slim/2.12.0)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-shared-dependencies/2.13.0/confidence-slim/2.12.0)](https://docs.renovatebot.com/merge-confidence/) |

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Renovate will not automatically rebase this PR, because other commits have been found.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, click this checkbox. ⚠ **Warning**: custom changes will be lost.

---

This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://app.renovatebot.com/dashboard#github/googleapis/java-retail).
github-actions bot pushed a commit that referenced this issue Jun 23, 2022
🤖 I have created a release *beep* *boop*
---


## [2.2.4](googleapis/java-retail@v2.2.3...v2.2.4) (2022-06-23)


### Dependencies

* update dependency com.google.cloud:google-cloud-shared-dependencies to v2.13.0 ([#470](googleapis/java-retail#470)) ([5a6339f](googleapis/java-retail@5a6339f))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
github-actions bot pushed a commit to suztomo/google-cloud-java that referenced this issue Jun 29, 2022
…manager to v0.119.3-alpha (googleapis#470)

[![WhiteSource Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [com.google.cloud:google-cloud-resourcemanager](https://github.com/GoogleCloudPlatform/google-cloud-java) | `0.119.2-alpha` -> `0.119.3-alpha` | [![age](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-resourcemanager/0.119.3-alpha/age-slim)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-resourcemanager/0.119.3-alpha/adoption-slim)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-resourcemanager/0.119.3-alpha/compatibility-slim/0.119.2-alpha)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-resourcemanager/0.119.3-alpha/confidence-slim/0.119.2-alpha)](https://docs.renovatebot.com/merge-confidence/) |

---

### Configuration

:date: **Schedule**: At any time (no schedule defined).

:vertical_traffic_light: **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

:recycle: **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

:no_bell: **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box.

---

This PR has been generated by [WhiteSource Renovate](https://renovate.whitesourcesoftware.com). View repository job log [here](https://app.renovatebot.com/dashboard#github/googleapis/java-resourcemanager).
github-actions bot pushed a commit to suztomo/google-cloud-java that referenced this issue Jul 1, 2022
🤖 I have created a release *beep* *boop*
---


### Updating meta-information for bleeding-edge SNAPSHOT release.

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
github-actions bot pushed a commit that referenced this issue Aug 16, 2022
…workloads to v2.1.0 (#470)

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [com.google.cloud:google-cloud-assured-workloads](https://github.com/googleapis/java-) | `2.0.0` -> `2.1.0` | [![age](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-assured-workloads/2.1.0/age-slim)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-assured-workloads/2.1.0/adoption-slim)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-assured-workloads/2.1.0/compatibility-slim/2.0.0)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://badges.renovateapi.com/packages/maven/com.google.cloud:google-cloud-assured-workloads/2.1.0/confidence-slim/2.0.0)](https://docs.renovatebot.com/merge-confidence/) |

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Renovate will not automatically rebase this PR, because other commits have been found.

🔕 **Ignore**: Close this PR and you won't be reminded about these updates again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, click this checkbox. ⚠ **Warning**: custom changes will be lost.

---

This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://app.renovatebot.com/dashboard#github/googleapis/java-assured-workloads).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzMi4xNTMuMCIsInVwZGF0ZWRJblZlciI6IjMyLjE1My4wIn0=-->
github-actions bot pushed a commit that referenced this issue Sep 30, 2022
🤖 I have created a release *beep* *boop*
---


## [0.13.3](googleapis/java-analytics-admin@v0.13.2...v0.13.3) (2022-09-29)


### Dependencies

* Update dependency cachetools to v5 ([#478](googleapis/java-analytics-admin#478)) ([1231930](googleapis/java-analytics-admin@1231930))
* Update dependency certifi to v2022.9.24 ([#460](googleapis/java-analytics-admin#460)) ([ec8852d](googleapis/java-analytics-admin@ec8852d))
* Update dependency charset-normalizer to v2.1.1 ([#464](googleapis/java-analytics-admin#464)) ([7aded8b](googleapis/java-analytics-admin@7aded8b))
* Update dependency click to v8.1.3 ([#465](googleapis/java-analytics-admin#465)) ([2ad11fb](googleapis/java-analytics-admin@2ad11fb))
* Update dependency gcp-releasetool to v1.8.8 ([#461](googleapis/java-analytics-admin#461)) ([52bcec4](googleapis/java-analytics-admin@52bcec4))
* Update dependency google-api-core to v2.10.1 ([#466](googleapis/java-analytics-admin#466)) ([f5f28e4](googleapis/java-analytics-admin@f5f28e4))
* Update dependency google-auth to v2.12.0 ([#467](googleapis/java-analytics-admin#467)) ([b96c8a3](googleapis/java-analytics-admin@b96c8a3))
* Update dependency google-cloud-core to v2.3.2 ([#462](googleapis/java-analytics-admin#462)) ([b444b65](googleapis/java-analytics-admin@b444b65))
* Update dependency google-cloud-storage to v2.5.0 ([#468](googleapis/java-analytics-admin#468)) ([620097f](googleapis/java-analytics-admin@620097f))
* Update dependency google-crc32c to v1.5.0 ([#469](googleapis/java-analytics-admin#469)) ([3f39cda](googleapis/java-analytics-admin@3f39cda))
* Update dependency googleapis-common-protos to v1.56.4 ([#463](googleapis/java-analytics-admin#463)) ([0fbc166](googleapis/java-analytics-admin@0fbc166))
* Update dependency importlib-metadata to v4.12.0 ([#470](googleapis/java-analytics-admin#470)) ([cc0108c](googleapis/java-analytics-admin@cc0108c))
* Update dependency jeepney to v0.8.0 ([#471](googleapis/java-analytics-admin#471)) ([1d09acc](googleapis/java-analytics-admin@1d09acc))
* Update dependency jinja2 to v3.1.2 ([#472](googleapis/java-analytics-admin#472)) ([9949a07](googleapis/java-analytics-admin@9949a07))
* Update dependency keyring to v23.9.3 ([#473](googleapis/java-analytics-admin#473)) ([443e7df](googleapis/java-analytics-admin@443e7df))
* Update dependency markupsafe to v2.1.1 ([#480](googleapis/java-analytics-admin#480)) ([ddebd04](googleapis/java-analytics-admin@ddebd04))
* Update dependency protobuf to v3.20.2 ([#481](googleapis/java-analytics-admin#481)) ([f0f032f](googleapis/java-analytics-admin@f0f032f))
* Update dependency protobuf to v4 ([#479](googleapis/java-analytics-admin#479)) ([754bb78](googleapis/java-analytics-admin@754bb78))
* Update dependency pyjwt to v2.5.0 ([#474](googleapis/java-analytics-admin#474)) ([6777481](googleapis/java-analytics-admin@6777481))
* Update dependency requests to v2.28.1 ([#475](googleapis/java-analytics-admin#475)) ([48dc786](googleapis/java-analytics-admin@48dc786))
* Update dependency typing-extensions to v4.3.0 ([#476](googleapis/java-analytics-admin#476)) ([8835380](googleapis/java-analytics-admin@8835380))
* Update dependency zipp to v3.8.1 ([#477](googleapis/java-analytics-admin#477)) ([3f004ad](googleapis/java-analytics-admin@3f004ad))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
github-actions bot pushed a commit that referenced this issue Oct 5, 2022
🤖 I have created a release *beep* *boop*
---


## [2.5.4](https://github.com/googleapis/java-security-private-ca/compare/v2.5.3...v2.5.4) (2022-10-03)


### Dependencies

* Update dependency certifi to v2022.9.24 ([#472](https://github.com/googleapis/java-security-private-ca/issues/472)) ([b7ac63c](https://github.com/googleapis/java-security-private-ca/commit/b7ac63c35497d3073146a3f917e9d71dfca6c7d5))
* Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 ([#481](https://github.com/googleapis/java-security-private-ca/issues/481)) ([0864f46](https://github.com/googleapis/java-security-private-ca/commit/0864f46174c3888ec1f28cbe6f0951abd069e68b))
* Update dependency google-api-core to v2.10.1 ([#469](https://github.com/googleapis/java-security-private-ca/issues/469)) ([e3a4332](https://github.com/googleapis/java-security-private-ca/commit/e3a4332bb76f06b6850dcb4ca0d6639284ff6129))
* Update dependency google-crc32c to v1.5.0 ([#470](https://github.com/googleapis/java-security-private-ca/issues/470)) ([f500bd9](https://github.com/googleapis/java-security-private-ca/commit/f500bd94f2237362038879f8b104ff79388270e4))
* Update dependency googleapis-common-protos to v1.56.4 ([#468](https://github.com/googleapis/java-security-private-ca/issues/468)) ([7a5b57b](https://github.com/googleapis/java-security-private-ca/commit/7a5b57b4730ffd93776118c9560e3b4a0f0733c0))
* Update dependency importlib-metadata to v4.12.0 ([#474](https://github.com/googleapis/java-security-private-ca/issues/474)) ([eb84232](https://github.com/googleapis/java-security-private-ca/commit/eb84232607ea80eb82bf8fd2b6da63f8594ceb33))
* Update dependency jeepney to v0.8.0 ([#471](https://github.com/googleapis/java-security-private-ca/issues/471)) ([f6da44a](https://github.com/googleapis/java-security-private-ca/commit/f6da44a8bde26f69274d0ef2e6984267e5e1476b))
* Update dependency jinja2 to v3.1.2 ([#475](https://github.com/googleapis/java-security-private-ca/issues/475)) ([7b39657](https://github.com/googleapis/java-security-private-ca/commit/7b396570d9e67206d206680180fdc32772193bc3))
* Update dependency keyring to v23.9.3 ([#476](https://github.com/googleapis/java-security-private-ca/issues/476)) ([03463c4](https://github.com/googleapis/java-security-private-ca/commit/03463c4b913fe798af911046b2128c4f8ee48327))
* Update dependency markupsafe to v2.1.1 ([#477](https://github.com/googleapis/java-security-private-ca/issues/477)) ([be28076](https://github.com/googleapis/java-security-private-ca/commit/be280768d46917a9922ae37565fb9f603c910783))
* Update dependency protobuf to v3.20.2 ([#478](https://github.com/googleapis/java-security-private-ca/issues/478)) ([4a3c940](https://github.com/googleapis/java-security-private-ca/commit/4a3c9400301db2a0af4a0375872a17b6fcacbefb))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
suztomo pushed a commit that referenced this issue Feb 1, 2023
…1.3 (#470)

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [com.google.cloud:libraries-bom](https://cloud.google.com/java/docs/bom) ([source](https://github.com/googleapis/java-cloud-bom)) | `26.1.2` -> `26.1.3` | [![age](https://badges.renovateapi.com/packages/maven/com.google.cloud:libraries-bom/26.1.3/age-slim)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://badges.renovateapi.com/packages/maven/com.google.cloud:libraries-bom/26.1.3/adoption-slim)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://badges.renovateapi.com/packages/maven/com.google.cloud:libraries-bom/26.1.3/compatibility-slim/26.1.2)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://badges.renovateapi.com/packages/maven/com.google.cloud:libraries-bom/26.1.3/confidence-slim/26.1.2)](https://docs.renovatebot.com/merge-confidence/) |

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, click this checkbox.

---

This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://app.renovatebot.com/dashboard#github/googleapis/java-iam).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzMi4yMTkuMSIsInVwZGF0ZWRJblZlciI6IjMyLjIxOS4xIn0=-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the BigQuery API. priority: p2 Moderately-important priority. Fix may not be included in next release. triaged for GA type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Development

No branches or pull requests

4 participants