Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check for Blobs' existence before uploading them #3028

Closed
arboleya opened this issue Aug 24, 2024 · 0 comments · Fixed by #3047
Closed

Check for Blobs' existence before uploading them #3028

arboleya opened this issue Aug 24, 2024 · 0 comments · Fixed by #3047
Assignees
Labels
feat Issue is a feature

Comments

@arboleya
Copy link
Member

The main idea is to:

  1. Given a list of Blob IDs, use a new endpoint to check for their existence
  2. Iterate the Blobs list, upload only non-existent ones, and skip the rest

To achieve this, we can use this new GraphQL endpoint introduced in v0.34.0:

Important:

  1. Perform a single request with multiple GQL queries, one per Blob ID (avoids unnecessary roundtrips)
  2. Make sure not to ask for the Blob bytecode in the query (avoids bloating server response)
@arboleya arboleya added the feat Issue is a feature label Aug 24, 2024
@arboleya arboleya changed the title Check for Blob's existence before uploading them Check for Blobs' existence before uploading them Aug 24, 2024
@danielbate danielbate self-assigned this Aug 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat Issue is a feature
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants