Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migrate away from google.com gcp project kubernetes-scale #2241

Closed
7 tasks done
spiffxp opened this issue Jun 17, 2021 · 9 comments
Closed
7 tasks done

Migrate away from google.com gcp project kubernetes-scale #2241

spiffxp opened this issue Jun 17, 2021 · 9 comments
Assignees
@ameukam
Labels
priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/release Categorizes an issue or PR as relevant to SIG Release. sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
sig-k8s-infra sig-testing issues
Milestone
v1.23

Comments

@spiffxp
Copy link
Member

spiffxp commented Jun 17, 2021 •
edited
Loading

Related:

Umbrella issue for migrating or removing dependence on the kubernetes-scale project. cs.k8s.io results show that:

We should:

/assign @ameukam
It turns out Arnaud has done a fair amount of this, but I just realized we never had an umbrella issue to tie it to the project we're working to replace. I'll link / edit what's been done so far

/priority important-soon
/wg k8s-infra
/sig scalability
/sig release
since these are release-informing but treated as release-blocking jobs
/sig testing
@k8s-ci-robot k8s-ci-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. wg/k8s-infra sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. sig/release Categorizes an issue or PR as relevant to SIG Release. sig/testing Categorizes an issue or PR as relevant to SIG Testing. labels Jun 17, 2021
@spiffxp spiffxp added this to Needs Triage in sig-k8s-infra via automation Jun 17, 2021
@spiffxp spiffxp added this to the v1.22 milestone Jun 17, 2021
@spiffxp
Copy link
Member Author

spiffxp commented Jun 17, 2021

/milestone v1.22
I'm not quite sure it's reasonable to expect we can flip this in time for Test Freeze, but we want this ready by the time the next cycle starts

@spiffxp spiffxp mentioned this issue Jun 17, 2021
Open
24 tasks
ameukam added a commit to ameukam/k8s.io that referenced this issue Jun 18, 2021
@ameukam
gcsweb: add buckets
badf0e4 
Add world-readable buckets k8s-infra-prow-results and
k8s-infra-scalability-tests-logs

Ref: kubernetes#2241
Ref: kubernetes#1394

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
This was referenced Jun 18, 2021
Merged
Merged
Merged
Closed
@ameukam
Copy link
Member

ameukam commented Jun 25, 2021 •
edited
Loading

Some issues about the canary jobs:

  • ci-kubernetes-e2e-gce-scale-correctness-canary requests compute resources superior to what the build clusters can offer. We may need adjust those requests. EDIT: I raised to quotas in Increase quotas for k8s-infra-e2e-scale-5k-project #2225
  • I see failures about gce instance access in ci-kubernetes-kubemark-gce-scale-canary, ci-kubernetes-e2e-gce-scale-performance-canary and ci-kubernetes-kubemark-gce-scale-scheduler-canary. I'll enable OS Login for k8s-infra-scale-e2e-5k-project project. EDIT/ os-loginis not needed for the scalability jobs.

@ameukam ameukam mentioned this issue Jul 23, 2021
Closed
@ameukam
Copy link
Member

ameukam commented Jul 23, 2021 •
edited
Loading

In the 2021-07-22 meeting of SIG-Scalability, @wojtek-t suggested to increase the gcp nodes to 5k for the optional presubmits. I will :

  • add a canary job for pull-kubernetes-e2e-gce-large-performance.
  • increase the quotas of CPU and persistent disks on k8s-infra-e2e-scale-5k-project.

ameukam added a commit to ameukam/test-infra that referenced this issue Jul 23, 2021
@ameukam
[wg-k8s-infra] add canary job for pull-kubernetes-e2e-gce-large-perfo…
e209fee 
…rmance

Ref: kubernetes/k8s.io#2241

Check if presubmit of 5k nodes can run community k8s-infra.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Jul 23, 2021
Merged
ameukam added a commit to ameukam/test-infra that referenced this issue Jul 23, 2021
@ameukam
[wg-k8s-infra] add canary job for pull-kubernetes-e2e-gce-large-perfo…
6d8c621 
…rmance

Ref: kubernetes/k8s.io#2241

Check if presubmit of 5k nodes can run community k8s-infra.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
ameukam added a commit to ameukam/test-infra that referenced this issue Jul 23, 2021
@ameukam
[wg-k8s-infra] add canary job for pull-kubernetes-e2e-gce-large-perfo…
e866d74 
…rmance

Ref: kubernetes/k8s.io#2241

Check if presubmit of 5k nodes can run community k8s-infra.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@spiffxp spiffxp added this to In Progress in sig-testing issues Jul 27, 2021
@spiffxp spiffxp moved this from Needs Triage to In Progress in sig-k8s-infra Aug 4, 2021
@spiffxp
Copy link
Member Author

spiffxp commented Aug 4, 2021

/milestone v1.23

@k8s-ci-robot k8s-ci-robot modified the milestones: v1.22, v1.23 Aug 4, 2021
@ameukam
Copy link
Member

ameukam commented Aug 25, 2021

@marseel @tosi3k You can use this issue as a reference for any progress made for the job migration.

@marseel
Copy link
Member

marseel commented Aug 25, 2021

/cc @jprzychodzen

ameukam added a commit to ameukam/test-infra that referenced this issue Sep 27, 2021
@ameukam
sig-k8s-infra: Add cleanup job for disk snapshots
10c47cb 
Related:
  - Ref: kubernetes/k8s.io#2241
  - Part of kubernetes/k8s.io#1469

Add a cleanup job that will delete disk snapshots older than 30 days created by sig-scalability periodic
job ci-golang-tip-k8s-1-18-canary.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Sep 27, 2021
Merged
ameukam added a commit to ameukam/test-infra that referenced this issue Sep 27, 2021
@ameukam
sig-k8s-infra: Add cleanup job for disk snapshots
aa1b9dd 
Related:
  - Ref: kubernetes/k8s.io#2241
  - Part of kubernetes/k8s.io#1469

Add a cleanup job that will delete disk snapshots older than 30 days created by sig-scalability periodic
job ci-golang-tip-k8s-1-18-canary.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Sep 29, 2021
Closed
ameukam added a commit to ameukam/test-infra that referenced this issue Sep 29, 2021
@ameukam
sig-k8s-infra: Add cleanup job for disk snapshots
89746ee 
Related:
  - Ref: kubernetes/k8s.io#2241
  - Part of kubernetes/k8s.io#1469

Add a cleanup job that will delete disk snapshots older than 30 days created by sig-scalability periodic
job ci-golang-tip-k8s-1-18-canary.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@k8s-ci-robot k8s-ci-robot added sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. and removed wg/k8s-infra labels Sep 29, 2021
@spiffxp
Copy link
Member Author

spiffxp commented Nov 1, 2021 •
edited
Loading

Look at job configs in kubernetes/test-infra, I see that ci-kubernetes-e2e-gce-scale-performance has been migrated away, but ci-kubernetes-e2e-gce-scale-correctness has not. Any particular reason why?

@spiffxp
Copy link
Member Author

spiffxp commented Nov 24, 2021

/close
Correctness was flipped over 7 days ago: kubernetes/test-infra#24080

Calling this done. Great work @ameukam !

@k8s-ci-robot
Copy link
Contributor

@spiffxp: Closing this issue.

In response to this:

/close
Correctness was flipped over 7 days ago: kubernetes/test-infra#24080

Calling this done. Great work @ameukam !

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sig-k8s-infra automation moved this from In Progress to Done Nov 24, 2021
sig-testing issues automation moved this from In Progress to Done Nov 24, 2021
@ameukam ameukam mentioned this issue Nov 24, 2021
Open
55 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ameukam ameukam

Labels
priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/release Categorizes an issue or PR as relevant to SIG Release. sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
sig-k8s-infra
  
Done
sig-testing issues
  
Done
Milestone
v1.23
Development

No branches or pull requests
4 participants
@spiffxp @marseel @ameukam @k8s-ci-robot