-
Notifications
You must be signed in to change notification settings - Fork 119
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for including detailed information in BigQuery.listTables
#3228
Comments
@anoopj What do you think about it? |
This will require API changes in BigQuery |
We've observed intermittent SLA failure when using |
This is a BigQuery SQL query - so it's capable of processing very large amounts of data. The SLO failures you may be seeing may be related to capacity allocated to your reservation (if you're using reservations). On-demand does not guarantee specific latencies since it uses a shared resource pool. The alternative proposed here (ie sending detailed info on |
I'm trying to use |
I'm not aware of any helper methods. @PhongChuong do you know? |
I have another question. I wanted to use
|
Is your feature request related to a problem? Please describe.
Metadata handling is too slow when getting table definitions in bulk.
Describe the solution you'd like
Add a new
TableListOption
that allows specifying fields so thatBigQuery.listTables
returns detailed information.Describe alternatives you've considered
I already tried getting table definitions in parallel on client side, but it's still slow.
Another solution is introducing cache, but we want to avoid as much as possible.
Additional context
trinodb/trino#4580 & trinodb/trino#10741
The text was updated successfully, but these errors were encountered: