Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable ephemeral storage in Katib Config #2315

Merged

Conversation

andreyvelich
Copy link
Member

Fixes: kubeflow/katib#1358.
Blocked by: #2312.

I added info about disabling ephemeral storage for suggestion and metrics collector container.

/assign @gaocegege @johnugeorge @kylepad
/cc @8bitmp3

@k8s-ci-robot
Copy link
Contributor

@andreyvelich: GitHub didn't allow me to assign the following users: kylepad.

Note that only kubeflow members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

Fixes: kubeflow/katib#1358.
Blocked by: #2312.

I added info about disabling ephemeral storage for suggestion and metrics collector container.

/assign @gaocegege @johnugeorge @kylepad
/cc @8bitmp3

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@kubeflow-bot
Copy link

This change is Reviewable

@andreyvelich andreyvelich force-pushed the issue-1358-disable-ephemeral-storage branch from 301149a to 5f39e10 Compare November 11, 2020 13:07
@andreyvelich andreyvelich changed the title [WIP] Disable ephemeral storage in Katib Config Disable ephemeral storage in Katib Config Nov 11, 2020
@andreyvelich
Copy link
Member Author

This PR is ready
/cc @gaocegege @johnugeorge @8bitmp3

Comment on lines 88 to 92
It is possible to not request the `ephemeral-storage` resource for the
metrics collector's container. For example to use
[GKE nodepool autoscalers](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations).
To do that, set the negative values for the `ephemeral-storage` requests and
limits in your Katib config:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The second sentence is not complete, I think.
The third sentence is not clear about what "that" is.
Can you revise them please?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, @8bitmp3.
What do you think about this:

 You can run your metrics collector container without requesting
 the `ephemeral-storage` resource from the Kubernetes cluster.
 For instance, if you want to use
 [Google Kubernetes Engine cluster autoscaler](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations)
 for your Katib experiments. To remove the `ephemeral-storage` resource from
 the metrics collector container, set the negative values for the
 `ephemeral-storage` requests and limits in your Katib config:

Comment on lines 224 to 227
suggestion's container. For example to use
[GKE nodepool autoscalers](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations).
To do that, set the negative values for the `ephemeral-storage` requests and
limits in your Katib config:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment on lines 90 to 94
For instance, if you want to use
[Google Kubernetes Engine cluster autoscaler](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations)
for your Katib experiments. To remove the `ephemeral-storage` resource from
the metrics collector container, set the negative values for the
`ephemeral-storage` requests and limits in your Katib config:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sentence looks like it starts with "if" and doesn't end.

Maybe you can try this, if I understood the logic correctly:

Suggested change
For instance, if you want to use
[Google Kubernetes Engine cluster autoscaler](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations)
for your Katib experiments. To remove the `ephemeral-storage` resource from
the metrics collector container, set the negative values for the
`ephemeral-storage` requests and limits in your Katib config:
For instance, when using the
[Google Kubernetes Engine cluster autoscaler](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations)
for your Katib experiments, you can remove the `ephemeral-storage` resource from
the metrics collector container by setting the negative values for the
`ephemeral-storage` requests and limits in your Katib config as follows:

WDYT?

Comment on lines 227 to 231
For instance, if you want to use
[Google Kubernetes Engine cluster autoscaler](https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-autoscaler#limitations)
for your Katib experiments. To remove the `ephemeral-storage` resource from
the suggestion container, set the negative values for the
`ephemeral-storage` requests and limits in your Katib config:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as the comment before - PTAL

Copy link
Member Author

@andreyvelich andreyvelich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I made changes.
PTAL @8bitmp3.

@8bitmp3
Copy link
Contributor

8bitmp3 commented Nov 12, 2020

Thank you and please assign/ping the Katib approvers here 👍 I'm not sure I'm part of OWNERS here

@andreyvelich
Copy link
Member Author

Thanks @8bitmp3.
/assign @gaocegege @johnugeorge
/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@gaocegege
Copy link
Member

/lgtm

@k8s-ci-robot k8s-ci-robot merged commit 3b107a6 into kubeflow:master Nov 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Documentation] Disable ephemeral storage for Suggestion and metrics collector resources
6 participants