Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add prow build clusters #830

Merged
merged 19 commits into from
May 26, 2020
Merged

Commits on May 6, 2020

  1. Configuration menu
    Copy the full SHA
    94c618a View commit details
    Browse the repository at this point in the history
  2. switch terraform required version to ~> 0.12.20

    specifically not doing this for aaa since I haven't touched it all
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    d6f85c4 View commit details
    Browse the repository at this point in the history
  3. Support is_prod_cluster in k8s-infra-gke-cluster

    This uses an ugly workaround but the theory is it's hidden in this
    module so may it's OK for consumers.
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    59c074f View commit details
    Browse the repository at this point in the history
  4. add image_type to nodepool module

    I suspect I'm going to have to tune prow-build's nodepool to use
    UBUNTU_CONTAINERD instead of COS for the benefit of kind ipv6 tests
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    3de2295 View commit details
    Browse the repository at this point in the history
  5. Initial spike for k8s-infra-prow-build

    Create a k8s-infra-gke-project module to manage the project that hosts
    the cluster. Since I deployed the prototype prow-build-test cluster in
    the kubernetes-public project, I based this module off of what looked
    relevant from `ensure-e2e-project.sh`
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    c112e9a View commit details
    Browse the repository at this point in the history
  6. add k8s resources intended for prow-build

    the daemonsets are to tune the build cluster for the benefit of tests
    that rely on kind
    
    I tried switching boskos-metrics to gce ingress but it expects any backed
    service to 200 OK on /, while the prometheus metrics endpoint exposed as
    boskos-metrics 404's on anything but /metrics
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    96d1693 View commit details
    Browse the repository at this point in the history
  7. change boskos pool name to k8s-infra-gce-project

    kubetest defaults to asking for a project of type `gce-project` if it's
    not explicitly specified via --gcp-project-type=. So initially I
    thought it would be a good idea to use that for the bsokos pool in this
    build cluster.
    
    The problem is when we try to use monitoring.prow.k8s.io's boskos
    resource dashboard to show this boskos' resources.  There's nothing to
    differentiate from k8s-prow-builds' gce-project pool, and this boskos'
    gce-project pool.
    
    The easiest thing to do for now is to use uniquely named pools across
    boskos instances. This will require that jobs explicitly add a flag
    --gcp-project-type=k8s-infra-gce-project when migrating to this
    build cluster
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    e3a3be6 View commit details
    Browse the repository at this point in the history
  8. add k8s-infra-prow-build-trusted

    use a smaller machine type and standard disk, to match what is
    currently used by k8s-prow/prow, which is the prow.k8s.io
    trusted cluster (but also the service cluster)
    
    for extra paranoia I have named the cluster and associated
    service accounts differently, so that somebody pointed at the wrong
    project couldn't accidentally the wrong cluster
    
    service accounts:
    - trusted cluster jobs have yet to require boskos so we're not going to
      make a service account for its janitor
    - allow jobs in this cluster to use the k8s-infra-gcp-auditor service
      account
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    f9cdbcd View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    c1b8f4e View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    8606717 View commit details
    Browse the repository at this point in the history
  11. create k8s-infra-e2e-projects and add to boskos

    created 2 manual projects and 40 boskos projects
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    acb0f31 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    179a7dc View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    17ffbd5 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    672d113 View commit details
    Browse the repository at this point in the history
  15. remove prow-build-test cluster

    actuated via:
    - terraform destroy before removing the .tf files
    - gcloud projects delete for the e2e projects
    - gcloud compute addresses delete for the boskos-metrics ip
    spiffxp committed May 6, 2020
    Configuration menu
    Copy the full SHA
    9d9483e View commit details
    Browse the repository at this point in the history

Commits on May 16, 2020

  1. refactor: make a projects dir

    make a projects dir and move all projects into it, instead of having
    modules be "the one dir that isn't a project"
    
    update README to follow suit
    spiffxp committed May 16, 2020
    Configuration menu
    Copy the full SHA
    3c2e795 View commit details
    Browse the repository at this point in the history
  2. refactor: drop k8s-infra prefix from modules

    update READMEs accordingly
    spiffxp committed May 16, 2020
    Configuration menu
    Copy the full SHA
    b834ccd View commit details
    Browse the repository at this point in the history
  3. drop TODOs about access

    this has been broken out into a separate issue
    spiffxp committed May 16, 2020
    Configuration menu
    Copy the full SHA
    e8ea80d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0d83cf8 View commit details
    Browse the repository at this point in the history