-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Old release branch test cleaning #18509
Old release branch test cleaning #18509
Conversation
9a8cea5
to
3784efa
Compare
/retest |
7c52545
to
4f3d3c2
Compare
/assign @dims |
@BenTheElder curious if you think I broek anything for Kind |
/approve |
thanks for doing this @tpepper |
/assign @BenTheElder |
4f3d3c2
to
13afa45
Compare
13afa45
to
1e6f456
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would be fine with this if you save 978458a (the cri-containerd jobs) for a different PR
- --repo=k8s.io/kubernetes=release-1.15 | ||
- --repo=github.com/containerd/cri=release/1.2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does cri 1.2 not work with later releases of kubernetes?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It might make sense to keep if there is somebody curating it. Perhaps it is a naive sign of me seeing a test of this odd combination (which mostly passes) and then jumping to an assumption of non-value. There might be value in a test called "containerd-node-conformance" if that is testing a meaningful variation. I don't understand what is this "1.2" thing though as there's no such tag on containerd/cri although it is a branch, which hasn't seen commits since January. There's a 1.3 branch active to March. And a 1.11 branch active through last year. Guess this isn't semver.
I would propose these old variations be dropped and an issue opened for a test plan of containerd variations. Based on curl http://storage.googleapis.com/k8s-metrics/failures-latest.json | grep -A1 containerd | grep -v ^--
, it seems there's a gap in curation on things containerd:
"ci-cri-containerd-e2e-gce-stackdriver": {
"failing_days": 889
"ci-cri-containerd-e2e-gci-gce-sd-logging": {
"failing_days": 856
"ci-cri-containerd-e2e-gci-gce-sd-logging-k8s-resources": {
"failing_days": 847
"ci-cri-containerd-e2e-gci-gce-statefulset": {
"failing_days": 808
"ci-cri-containerd-node-e2e-serial": {
"failing_days": 760
"ci-cri-containerd-e2e-gci-gce-es-logging": {
"failing_days": 651
"ci-cri-containerd-node-e2e-flaky": {
"failing_days": 426
"ci-kubernetes-e2e-windows-containerd-gce": {
"failing_days": 235
"ci-kubernetes-e2e-containerd-gce-netd-calico": {
"failing_days": 232
"ci-kubernetes-e2e-containerd-gce-netd": {
"failing_days": 232
"ci-cri-containerd-e2e-ubuntu-gce": {
"failing_days": 177
"ci-containerd-e2e-ubuntu-gce": {
"failing_days": 177
"ci-kubernetes-e2e-windows-containerd-gce-1-18": {
"failing_days": 164
"ci-cri-containerd-e2e-gci-gce-flaky": {
"failing_days": 153
"ci-cri-containerd-e2e-gci-gce-alpha-features": {
"failing_days": 126
"ci-containerd-soak-gci-gce": {
"failing_days": 125
"pr:pull-cri-containerd-windows-cri": {
"failing_days": 119
"ci-cri-containerd-node-e2e-benchmark": {
"failing_days": 119
"ci-cri-containerd-cri-validation-windows": {
"failing_days": 119
"ci-containerd-node-e2e-features-1-2": {
"failing_days": 119
"ci-kubernetes-e2e-aks-engine-azure-master-windows-containerd-hyperv": {
"failing_days": 87
"ci-kubernetes-e2e-aks-engine-azure-master-windows-containerd-hyperv-serial-slow": {
"failing_days": 87
"ci-containerd-node-e2e-features-1-3": {
"failing_days": 60
"ci-containerd-node-e2e-1-3": {
"failing_days": 60
"ci-containerd-node-e2e-1-2": {
"failing_days": 60
"ci-kubernetes-e2e-gci-gce-scalability-containerd-correctness": {
"failing_days": 44
"ci-kubernetes-e2e-aks-engine-master-windows-containerd-azuredisk-csi-driver": {
"failing_days": 31
Despite that some of the boards at https://testgrid.k8s.io/sig-node-containerd do have a lot of green. It's not clear much of that green is relevant...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
aaand you already did #18570 thanks
1e6f456
to
456e94f
Compare
These are a set of old tests which have been failing for a long time and are against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These are a set of old tests which have been failing for a long time and are against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These are a set of old tests which have been failing for a long time and are against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These are against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These are a set of old tests which in many cases have been failing for a long time and are against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
There is no longer CI on release-1.15 so it doesn't need skipped. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These is an against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
These is an against an old enough codebase to be irrelevant for the upstream community. Signed-off-by: Tim Pepper <tpepper@vmware.com>
There is no longer activity on these branches. Signed-off-by: Tim Pepper <tpepper@vmware.com>
456e94f
to
8b8ea59
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/approve
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: dims, spiffxp, tpepper The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
@tpepper: Updated the
In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
Sorry for not noticing earlier, but with Gardener we actually
I understand the cleanup intent, but feel this is a bit overdone as the actively reported tests do have a certain value for our customers. |
Following today's SIG Testing meeting on cleaning up test noise I was looking at some items in http://storage.googleapis.com/k8s-metrics/failures-latest.json and adjacent test configs. The PR is an attempt to start cleaning out things that were at most relevant back at times when we were dealing with releases which are no longer community supported. This obscures current work.
Signed-off-by: Tim Pepper tpepper@vmware.com