Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DLI Flink job creation with Terraform blocks terraform resource creation, update or deletion #5357

Open
mvhuawei opened this issue Aug 7, 2024 · 0 comments

Comments

@mvhuawei
Copy link

mvhuawei commented Aug 7, 2024

Terraform Version

Terraform v1.9.3
on windows_amd64
+ provider registry.terraform.io/huaweicloud/huaweicloud v1.67.0

Terraform Configuration Files

provider "huaweicloud" {
   region = "eu-west-101"  
   access_key = ""
   secret_key = ""  
   auth_url = "https://iam.eu-west-101.myhuaweicloud.eu/v3"    
   cloud = "myhuaweicloud.eu"     
   endpoints = {
      bssv2 = "https://bss.myhuaweicloud.eu"
   }
}

resource "huaweicloud_dli_queue" "dli-queue-bigdata" {
  name     = "queue_bigdata"

  cu_count = 16 
  queue_type = "general" 

  resource_mode = 1
  vpc_cidr = "172.16.0.0/12"
}

resource "huaweicloud_dli_flinksql_job" "dli-flinksql-job" {
  name = "real_time_analytics_flink_sql"
  type = "flink_opensource_sql_job"
  sql  = "${file("flink_job.txt")}"

  cu_number = 4
  manager_cu_number = 1
  parallel_number = 4
  queue_name = huaweicloud_dli_queue.dli-queue-bigdata.name
  run_mode = "exclusive_cluster"
}

Debug Output

╷
│ Error: error getting properties of the queue (queue_bigdata): Resource not found: [GET https://dli.eu-west-101.myhuaweicloud.eu/v3/51ba9bb265a44048bf83679e432dc7fd/queues/queue_bigdata/properties], request_id: 0d15ef4ce2b61da46a9718a3aae74284, error message: {"error_msg":"The API does not exist or has not been published in the environment","error_code":"APIGW.0101","request_id":"0d15ef4ce2b61da46a9718a3aae74284"}
│ 
│
│   with huaweicloud_dli_queue.dli-queue-bigdata,
│   on main.tf line 408, in resource "huaweicloud_dli_queue" "dli-queue-bigdata":
│  408: resource "huaweicloud_dli_queue" "dli-queue-bigdata" {
│
╵

Crash Output

Expected Behavior

Terraform resources creation completes without errors

Actual Behavior

Unknown errors blocks the resources creation, update or deletion

Steps to Reproduce

1.  Replace in main.tf access key and secret key with your credentials
2.  Add this file 'flink_job.txt' to main folder
3.  terraform init 
4.  terraform apply

flink_job.txt

Additional Context

References

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant