Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(bigquery): add Dataset.default_partition_expiration_ms and Table.require_partition_filter properties #9464

Merged
merged 3 commits into from
Oct 15, 2019

Conversation

tswast
Copy link
Contributor

@tswast tswast commented Oct 14, 2019

Samples double as system tests. I aim to use them here:

Note: this also (silently) deprecates
TimePartitioning.require_partition_filter, as that's duplicating the
same functionality.

I was curious why the expiration_ms wasn't also moving up, but then I
realized that property only makes sense if a partition is assocatied
with a timestamp.

…require_partition_filter properties

Samples double as system tests. I aim to use them here:

* https://cloud.google.com/bigquery/docs/managing-partitioned-tables#require-filter
* https://cloud.google.com/bigquery/docs/updating-datasets#partition-expiration

Note: this also (silently) deprecates
TimePartitioning.require_partition_filter, as that's duplicating the
same functionality.

I was curious why the expiration_ms wasn't also moving up, but then I
realized that property only makes sense if a partition is assocatied
with a timestamp.
@tswast tswast requested a review from a team October 14, 2019 23:10
@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Oct 14, 2019
@tswast tswast changed the title feat(bigquery): add Dataset.default_partiion_expiration_ms and Table.require_partition_filter properties feat(bigquery): add Dataset.default_partition_expiration_ms and Table.require_partition_filter properties Oct 14, 2019
If set to true, queries over the partitioned table require a
partition filter that can be used for partition elimination to be
specified.
DEPRECATED: Use
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are there any annotations we can/should add to help docs/and existing consumers to understand this is no longer the preferred mechanism?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Added deprecation warning message in 84e2c3c

@tswast tswast merged commit 2fdd6e6 into googleapis:master Oct 15, 2019
@tswast tswast deleted the bq-require-partition-filter branch October 15, 2019 22:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla: yes This human has signed the Contributor License Agreement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants