Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix TestAccAlloydbInstance_updateDatabaseFlagInPrimaryInstance by increasing timeouts #8018

Conversation

ScottSuarez
Copy link
Contributor

https://ci-oss.hashicorp.engineering/project.html?projectId=GoogleCloud&testNameId=1674360380034955101&tab=testDetails

Release Note Template for Downstream PRs (will be copied)

alloydb: increased timeouts for `google_alloydb_instance` from 20m to 40m

@ScottSuarez ScottSuarez requested review from a team and zli82016 and removed request for a team May 24, 2023 22:30
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

Terraform GA: Diff ( 2 files changed, 6 insertions(+), 6 deletions(-))
Terraform Beta: Diff ( 2 files changed, 6 insertions(+), 6 deletions(-))
TF Conversion: Diff ( 2 files changed, 3 insertions(+), 3 deletions(-))

Copy link
Member

@zli82016 zli82016 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 2751
Passed tests 2461
Skipped tests: 283
Affected tests: 7

Action taken

Found 7 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
TestAccDataSourceGoogleFirebaseAndroidAppConfig|TestAccComputeFirewallPolicyRule_multipleRules|TestAccApigeeKeystoresAliasesPkcs12_ApigeeKeystoresAliasesPkcs12Example|TestAccAlloydbBackup_missingLocation|TestAccAlloydbCluster_missingLocation|TestAccDataSourceAlloydbLocations_basic|TestAccApigeeKeystoresAliasesKeyCertFile_apigeeKeystoresAliasesKeyCertFileTestExample

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

Tests passed during RECORDING mode:
TestAccDataSourceGoogleFirebaseAndroidAppConfig[Debug log]
TestAccApigeeKeystoresAliasesPkcs12_ApigeeKeystoresAliasesPkcs12Example[Debug log]
TestAccAlloydbBackup_missingLocation[Debug log]
TestAccAlloydbCluster_missingLocation[Debug log]
TestAccDataSourceAlloydbLocations_basic[Debug log]
TestAccApigeeKeystoresAliasesKeyCertFile_apigeeKeystoresAliasesKeyCertFileTestExample[Debug log]

Tests failed during RECORDING mode:
TestAccComputeFirewallPolicyRule_multipleRules[Error message] [Debug log]

Please fix these to complete your PR
View the build log or the debug log for each test

@paraggoyal92
Copy link

Can you please add the reason of this update in the PR request?

shourya116 pushed a commit to shourya116/magic-modules that referenced this pull request May 25, 2023
@ScottSuarez
Copy link
Contributor Author

ci-oss.hashicorp.engineering/project.html?projectId=GoogleCloud&testNameId=1674360380034955101&tab=testDetails

From our test run

        Error: Error waiting for Updating Instance: timeout while waiting for state to become 'done: true' (last state: 'done: false', timeout: 20m0s)
        
          with google_alloydb_instance.primary,
          on terraform_plugin_test.tf line 2, in resource "google_alloydb_instance" "primary":
           2: resource "google_alloydb_instance" "primary" {
        
--- FAIL: TestAccAlloydbInstance_updateDatabaseFlagInPrimaryInstance (2511.74s)
FAIL

If you believe this is incorrect feel free to open a new pr to adjust them into another range.

@paraggoyal92
Copy link

40 minutes seems too high. It could be an outlier. Could you please run this multiple times and come up with a better threshold, such as the 95th percentile of all the times? I am just worried that we might end up consuming actual errors with this high threshold number.

@ScottSuarez
Copy link
Contributor Author

Unfortunately I won't have time to re-engage this issue since I'm no longer on duty. If you like, open a PR to reduce the timeout range. If our team infra sees repeated failures we may need to reraise.

ericayyliu pushed a commit to ericayyliu/magic-modules that referenced this pull request Jul 26, 2023
wj-chen pushed a commit to wj-chen/magic-modules that referenced this pull request Aug 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants