Skip to content
This repository has been archived by the owner on May 16, 2023. It is now read-only.

[meta] stabilize CI tests #935

Merged
merged 5 commits into from
Nov 25, 2020
Merged

[meta] stabilize CI tests #935

merged 5 commits into from
Nov 25, 2020

Conversation

jmlrt
Copy link
Member

@jmlrt jmlrt commented Nov 25, 2020

This PR add some improvements to stabilize CI tests which are flaking at this time:

  • watch resources rollout after upgrade to ensure that goss tests when rollout is done
  • use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
  • remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
  • increase some more timeouts for Elasticsearch tests
  • standardize examples to simplify maintenance and diff

This commit watch resources rollout after upgrade to ensure that goss
tests are run on "upgraded" pods.
@jmlrt jmlrt added the meta label Nov 25, 2020
@jmlrt jmlrt requested a review from a team November 25, 2020 12:32
@jmlrt jmlrt marked this pull request as draft November 25, 2020 13:14
This commit standardizes the examples to simplify their maintenance:
- use variable for timeout values
- use `.yaml` extension for every test value files
- rename security examples yaml files for consistency with other
  examples values files
- reorder and standardize make targets to simplify diff
- remove unused or obsolete make targets
@jmlrt
Copy link
Member Author

jmlrt commented Nov 25, 2020

jenkins test this please

1 similar comment
@jmlrt
Copy link
Member Author

jmlrt commented Nov 25, 2020

jenkins test this please

This commit update goss `kubectl get pod` command to retrieve only
running pods and sort them by age, then use the newer pod for goss test.

This is required to ensure that we aren't running goss tests on an older
pod which is terminating.
This commit remove the hostname checks into goss tests to avoid error
when goss tests aren't run on the first pod.
@jmlrt jmlrt changed the title [meta] watch upgrade rollout [meta] stabilize CI tests Nov 25, 2020
@jmlrt jmlrt marked this pull request as ready for review November 25, 2020 16:24
@jmlrt
Copy link
Member Author

jmlrt commented Nov 25, 2020

CI test is 🟢 again 🎉

Copy link
Contributor

@Conky5 Conky5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 💯

@jmlrt jmlrt merged commit 87be9d6 into elastic:master Nov 25, 2020
@jmlrt jmlrt deleted the upgrade-rollout branch November 25, 2020 16:46
jmlrt added a commit to jmlrt/helm-charts that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
jmlrt added a commit to jmlrt/helm-charts that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
jmlrt added a commit to jmlrt/helm-charts that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
jmlrt added a commit that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
jmlrt added a commit that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
jmlrt added a commit that referenced this pull request Nov 25, 2020
This PR add some improvements to stabilize CI tests which are flaking at this time:

- watch resources rollout after upgrade to ensure that goss tests when rollout is done
- use newest running pod for goss tests to ensure that it is not using a pod from previous release or a pod which is terminating
- remove mention of hostname in goss tests to ensure that test can run in every pods of the Statefulsets, DaemonSets or Deployments
- increase some more timeouts for Elasticsearch tests
- standardize examples to simplify maintenance and diff
@jmlrt jmlrt mentioned this pull request Feb 8, 2021
This was referenced Feb 12, 2021
@jmlrt jmlrt mentioned this pull request Feb 18, 2021
This was referenced Mar 15, 2021
@jmlrt jmlrt mentioned this pull request May 25, 2021
@jmlrt jmlrt mentioned this pull request Mar 8, 2022
@jmlrt jmlrt mentioned this pull request Apr 21, 2022
This was referenced Sep 14, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants