Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create basic K8s Config #18

Merged
merged 5 commits into from
Aug 18, 2023
Merged

Conversation

todaywasawesome
Copy link
Contributor

Ok, we have a very basic config here that moves the env stuff into a configmap.

To deploy to Kubernetes first create a namespace:

kubectl create ns llama

Then apply the manifests under the /deploy/kubernetes directory with

kubectl apply -k deploy/kubernetes/. -n llama

Screenshot 2023-08-17 at 3 18 16 PM

Screenshot 2023-08-17 at 3 19 25 PM

Expose your service however you would normally do that.

Signed-off-by: Dan Garfield <dan@codefresh.io>
Signed-off-by: Dan Garfield <dan@codefresh.io>
Signed-off-by: Dan Garfield <dan@codefresh.io>
Signed-off-by: Dan Garfield <dan@codefresh.io>
@todaywasawesome
Copy link
Contributor Author

Closes #15

@todaywasawesome
Copy link
Contributor Author

@mayankchhabra I could add network model storage support here. I think I would want an image that doesn't include any models to go with it. https://github.com/getumbrel/llama-gpt/blob/master/api/Dockerfile

@mayankchhabra
Copy link
Member

Sweet! Thanks for working on this @todaywasawesome! Shall we wait for #19 to be merged first? That will remove the models from the images.

@todaywasawesome
Copy link
Contributor Author

@mayankchhabra your call, if it were me I would probably merge now while there are lots of people interested in trying it. It'll be easy to update once #19 is done.

@todaywasawesome
Copy link
Contributor Author

@mayankchhabra it's also easy to update which image is being used by anyone consuming our kustomize so they can swap it out whenever they're ready.

@mayankchhabra
Copy link
Member

Fair enough! I haven't been able to test it, but let's roll with it since you've it running. Thanks again for your work!

@mayankchhabra mayankchhabra merged commit ca6ec9b into getumbrel:master Aug 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants