Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provision Minio bucket lifecycle rules when deploying Kubeflow #2375

Closed
wooleybugger opened this issue Feb 1, 2023 · 10 comments
Closed

Provision Minio bucket lifecycle rules when deploying Kubeflow #2375

wooleybugger opened this issue Feb 1, 2023 · 10 comments

Comments

@wooleybugger
Copy link

Is it possible to provision minio bucket lifecycle rules when deploying Kubeflow and if so where/how?

I am looking for the manifest that will allow me to provision lifecycle rules on kubeflow minio storage buckets. The desire is to have the rules in place prior to deployment of Kubeflow. The closest possibility appears to be
apps/pipeline/upstream/third-party/argo/base/workflow-controller-configmap-patch.yaml or apps/pipeline/upstream/third-party/argo/upstream/manifests/quick-start/base/overlays/workflow-controller-configmap.yaml, but no "cigar".

Thanks

@juliusvonkohout
Copy link
Member

We are moving away from minio and we ship a 3 year old insecure version.

@wooleybugger
Copy link
Author

Can you say what storage solution you are moving to and when?

@juliusvonkohout
Copy link
Member

There are some bugs here regarding the minio replacement kubeflow/pipelines#7725

@wooleybugger
Copy link
Author

Well there is alot to read there. My takeaway is that Zenko cloudserver and S3Proxy are the choices, depending if AWS/GCS or on-premises. Not sure if S3proxy equates to "file backend".

" So to summarize we try Zenko cloudserver (Apache 2 licence and actively maintained and proposed by james Liu) in gateway mode for AWS and GCP and with the file backend for on-premises deployments."

@wooleybugger
Copy link
Author

@juliusvonkohout , Is there a roadmap/timeline for the replacement of Minio?

@juliusvonkohout
Copy link
Member

@juliusvonkohout , Is there a roadmap/timeline for the replacement of Minio?

according to google after Q2 2023 the will start working on it.

@wooleybugger
Copy link
Author

Thanks

@juliusvonkohout
Copy link
Member

juliusvonkohout commented Nov 29, 2023

@wooleybugger can you join the KFP community meetings and discuss this with google again?

Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Copy link

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Closed
Development

No branches or pull requests

2 participants