Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase test timeout to fix intermittent failures of ingress tests #1612

Merged
merged 3 commits into from
Jun 14, 2020

Conversation

tdyas
Copy link
Contributor

@tdyas tdyas commented May 31, 2020

Various tests in testIngressEndpoints in source/ingress_test.go consistently fail for me when I run make build.push to publish a custom external-dns image (with IMAGE_REGISTRY overridden). The specific sub-test changes each time. Increasing the 3 second wait for Ingress resources to 6 seconds fixes the issue by giving the tests more time to see the relevant Ingress resources appear in the informer cache.

A better solution would be to not poll and actually attach a watcher to wait for the API object additions to stabilize.

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label May 31, 2020
@k8s-ci-robot k8s-ci-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label May 31, 2020
@tdyas
Copy link
Contributor Author

tdyas commented May 31, 2020

/assign @Raffo

@Raffo
Copy link
Contributor

Raffo commented Jun 1, 2020

I would go with removing the poll, if you are up to. I agree that flaky tests are bad, but I'd also love to remove possible races as much as possible.

@tdyas
Copy link
Contributor Author

tdyas commented Jun 3, 2020

I would go with removing the poll, if you are up to. I agree that flaky tests are bad, but I'd also love to remove possible races as much as possible.

I am. Will update the PR to replace the poll.

@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Jun 3, 2020
@tdyas
Copy link
Contributor Author

tdyas commented Jun 3, 2020

@Raffo: I updated the test to check the source's informer cache to determine when it sees all of the relevant Ingress resources. Although this violates encapsulation, using a second informer cache in the test to wait for the resources to be visible introduces the possibility that the source's informer has not updated to be as current as the second informer cache, which I wanted to avoid. Thoughts?

@Raffo
Copy link
Contributor

Raffo commented Jun 14, 2020

This looks good to me. Let's get this in and see if we reduced the flakes significantly, thank you for the contribution @tdyas !

@Raffo
Copy link
Contributor

Raffo commented Jun 14, 2020

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 14, 2020
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Raffo, tdyas

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 14, 2020
@k8s-ci-robot k8s-ci-robot merged commit 6cc11d0 into kubernetes-sigs:master Jun 14, 2020
@tdyas tdyas deleted the increase_test_timeout branch June 15, 2020 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants