-
Notifications
You must be signed in to change notification settings - Fork 791
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Move perf-dash to community owned infra #549
Comments
If there will be help from people who has access to the current cluster I can help with moving that and actually own the ticket |
I'm not sure about the k8s-mungegithub cluster being maintained or not, but we definitely maintain and use perf-dash on a regular basis. We do have access to the current cluster and can help with providing all the info you need. The only requirement we have is for the sig-scalability folks to have the ability to view perf-dash logs and be able to deploy new versions of perf-dash whenever we need it. |
@mm4tt that would be greatly appreciated! ideally we can move things over to a CNCF cluster where the sig-scale community at large can be granted access as needed and we can spin down the google.com cluster/project. |
Sure thing. It looks like deploying perf-dash is as simple as deploying this deployment and service: On top of that we have the perf-dash.k8s.io domain configured to point to the external IP address of the perf-dash service. I have no knowledge on how the domain is configured though. Let me know if there is anything else you need from us. |
The FQDN is managed through OctoDNS: https://github.com/kubernetes/k8s.io/blob/master/dns/zone-configs/k8s.io._0_base.yaml#L170. |
I'm gonna start some work in that area today. :-) If I'll need anything I'm gonna ping you @mm4tt |
I have started moving perf-dash to |
Also @BenTheElder I'm digging a little bit into how our DNS is working trying to figure out how to add another subdomain which will be pointing to /assign @BenTheElder |
Wait - a DASHBOARD app needs 8 GB of memory?
Can someone explain why?
…On Fri, Mar 6, 2020 at 1:26 AM Bart Smykla ***@***.***> wrote:
Also @BenTheElder I'm digging a little bit into how our DNS is working trying to figure out how to add another subdomain which will be pointing to aaa.
Should it be added like gcsweb? I mean create another ingress which will create loadbalancer and then point subdomain to the IP of that loadbalancer? It looks a little bit unnecessary and maybe to bit "static"?
/assign @BenTheElder
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
I am 100% in favor of moving this, but we need to understand the
resource footprint.
…On Fri, Mar 6, 2020 at 1:36 PM Tim Hockin ***@***.***> wrote:
Wait - a DASHBOARD app needs 8 GB of memory?
Can someone explain why?
On Fri, Mar 6, 2020 at 1:26 AM Bart Smykla ***@***.***> wrote:
>
> Also @BenTheElder I'm digging a little bit into how our DNS is working trying to figure out how to add another subdomain which will be pointing to aaa.
> Should it be added like gcsweb? I mean create another ingress which will create loadbalancer and then point subdomain to the IP of that loadbalancer? It looks a little bit unnecessary and maybe to bit "static"?
>
> /assign @BenTheElder
>
> —
> You are receiving this because you were assigned.
> Reply to this email directly, view it on GitHub, or unsubscribe.
|
@bartsmykla our DNS supports standard records, just checked into config here, we have CNAME, A, etc.
I don't know how prescriptive we want to be about this exactly. Static Loadbalancer IPs have worked fine for our existing infra though. Why would we expect it to be more "dynamic"? |
Yes, a static IP is totally fine. Prefer Ingress to Service type=LB
because of certs
…On Fri, Mar 6, 2020 at 4:24 PM Benjamin Elder ***@***.***> wrote:
@bartsmykla our DNS supports standard records, just checked into config here, we have CNAME, A, etc.
Should it be added like gcsweb? I mean create another ingress which will create loadbalancer and then point subdomain to the IP of that loadbalancer? It looks a little bit unnecessary and maybe to bit "static"?
I don't know how prescriptive we want to be about this exactly. Static Loadbalancer IPs have worked fine for our existing infra though. Why would we expect it to be more "dynamic"?
(Especially note that the DNS pointing to that IP is a yaml config PR away so if we switch it to something else later no big deal...)
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
@BenTheElder @thockin got it, thank you for info, and I'm gonna proceed with that approach! :-) |
Also @mm4tt, can you give your opinion about why it needs 8GB of RAM? /assign @mm4tt |
I know that the memory footprint is a bit unexpected, but it's that, as it stores in memory all the data that it serves.
And all the metrics that we have, across all jobs sum up to a lot of data. |
+1 to add an appropriate node to our cluster. if i remember right, we used terraform to stand up this cluster, so the changes would have to be done there. |
Sorry to be a pain in the rear. @wojtek-t what sort of traffic is this serving to justify being entirely in memory? If we added n1-standard-4 VMs that's $30/mo each. We could add n1-highmem-2 for a bit less but may be less useful. In other words, if that had to serve from disk, what bad things would happen? |
I am fine to add a second pool of n1-standard-4, I just don't want to be wasteful |
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
I have created PR with next steps in its description, so feel free to do review :-) |
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
Applies to: kubernetes#549 Signed-off-by: Bart Smykla <bsmykla@vmware.com>
As a followup for the people who don't follow the PR#721. We have |
/area cluster-infra |
/sig scalability |
I think I found was was causing the issue with accessing the namespaces! [#758] |
I confirm, I have access and everything seems to be working as it should. We can proceed with pointing perf-dash.k8s.io to the new cluster. |
My plan right now is:
|
I think it's the time for celebration as we managed to get all steps done! :-) /close |
@bartsmykla: Closing this issue. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
🎉
…On Wed, Apr 22, 2020, 01:53 Kubernetes Prow Robot ***@***.***> wrote:
@bartsmykla <https://github.com/bartsmykla>: Closing this issue.
In response to this
<#549 (comment)>:
I think it's the time for celebration as we managed to get all steps done!
:-)
/close
Instructions for interacting with me using PR comments are available here
<https://git.k8s.io/community/contributors/guide/pull-requests.md>. If
you have questions or suggestions related to my behavior, please file an
issue against the kubernetes/test-infra
<https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:>
repository.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#549 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAHADK44E6QC3C3N7O67UKDRN2V77ANCNFSM4KMHGEJA>
.
|
Thanks, @bartsmykla !!! |
http://perf-dash.k8s.io/ is running on the "k8s-mungegithub" cluster in an old google internal GCP project, this cluster is still using
kube-lego
and is not actively maintained as far as I can tell, we should move it to community managed infra (or turn it down if nobody is going to maintain it).cc @krzysied
The text was updated successfully, but these errors were encountered: