Feature Request: Add BigQuery Jobs

[tomstockton]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

As a user I would like to be able to load data (via Terraform) into my bigquery table from one of the supported data sources (cloud storage or local file)

I'd be happy to specify these attributes either as part of the existing google_bigquery_table resource or as a new resource type google_bigquery_job_load.

The current resource type of google_bigquery_table does not support the loading of data at the time of the creation of the table as per the CLI (https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-csv#bigquery_load_table_gcs_csv-cli)

Neither is there a resource type available to specify a bigquery job to schedule the loading of data into an existing table - this functionality is available via the API (https://cloud.google.com/bigquery/docs/reference/rest/v2/JobConfiguration#JobConfigurationLoad) but is not available via Terraform.

New or Affected Resource(s)

• google_bigquery_job_load (new) OR
• google_bigquery_table (extend)

Potential Terraform Configuration

resource "google_bigquery_job_load" "default" {
  project_id  = "myproject"
  dataset_id = "${google_bigquery_dataset.default.dataset_id}"
  table_id     = "bar"
  source_uri = "gs://my_bucket/my_data.csv"
  # see full list of attributes [here](https://cloud.google.com/bigquery/docs/reference/rest/v2/JobConfiguration#JobConfigurationLoad)

References

https://cloud.google.com/bigquery/docs/loading-data
https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/insert
https://cloud.google.com/bigquery/docs/reference/rest/v2/JobConfiguration#JobConfigurationLoad

• #0000

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 hashibot-feedback@hashicorp.com. Thanks!