Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use compression in LoadJobConfig #1499

Closed
omerda123 opened this issue Feb 15, 2023 · 2 comments
Closed

Use compression in LoadJobConfig #1499

omerda123 opened this issue Feb 15, 2023 · 2 comments
Assignees
Labels
api: bigquery Issues related to the googleapis/python-bigquery API.

Comments

@omerda123
Copy link

I updated bigquery python client from version 1.27.2 to 2.34.3.
I used SNAPPY compression for LoadJobs and after the upgrade I'm getting this error message:
Property compression is unknown for <class 'google.cloud.bigquery.job.load.LoadJobConfig'>
according to this doc: https://cloud.google.com/bigquery/docs/reference/rest/v2/Job#JobConfigurationLoad compression is supported.
Can I get some clarification here? There is any kind of compression? it's not longer supported? Didn't find any release notes / changelogs

Thanks!

@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery API. label Feb 15, 2023
@skudrow-figure
Copy link

Had the same issue. Ended up not specifying the compression at all and it successfully loaded my json.gz file

@meredithslota
Copy link
Contributor

The last change here was, I think, #361 which refactored but didn't remove compression support (and the previous paths are still supported, as far as I know though I haven't investigated it deeply yet). This was in November 2020, which would have roughly corresponded to v2.3.0 — and any future versions.

SNAPPY compression is supported for Avro files only. Can you share an example of how you're using this?

https://github.com/googleapis/python-bigquery/blob/main/google/cloud/bigquery/enums.py for reference.

@meredithslota meredithslota self-assigned this Jun 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery API.
Projects
None yet
Development

No branches or pull requests

3 participants