AppScaling policy DescribeScalingPolices FailedResourceAccessException due to throttling

[s-maj]

When Terraform is refreshing AWS resources (during plan or apply) and there is a lot of aws_appautoscaling_policy with tons of Cloudwatch alarms, describe on aws_appautoscaling_policy might return FailedResourceAccessException, which is not retried by AWS SDK. According to AWS guys (see references), it's up to the client to decide if it should retry on this error. It's a very similar case to Kinesis throttling (see references) issue that was solved a while ago.

Terraform Version

0.9.11 and 0.10.0

Affected Resource(s)

• aws_appautoscaling_policy

Debug Output

FailedResourceAccessException: Unable to retrieve alarms for scaling policy $policy_arn due to reason: Rate exceeded (Service: AmazonCloudWatch; Status Code: 400; Error Code: Throttling; Request ID: ce1253eb-81e9-11e7-ba0a-dd79b677bd46)

Expected Behavior

Terraform should retry on the error

Actual Behavior

Terraform exits on the error

References

• Add retries for Kinesis throttling exceptions #1085
• AppScaling DescribeScalingPolices FailedResourceAccessException due to throttling aws/aws-sdk-go#1472

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. Thanks!