Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NVIDIA NIM tutorial #736

Closed
wants to merge 20 commits into from

Conversation

brandonroyal
Copy link
Contributor

Step by step tutorial for deploying an NVIDIA NIM on GKE with A100 GPUs.

Copy link

google-cla bot commented Jul 15, 2024

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

richardsliu and others added 20 commits July 15, 2024 14:30
* move mysql stuff to jupyter

* new notebook

* fix notebook

* fix notebook, add markdown

* use bulk insert

* revert

* change persist data

* terraform fmt

* remove sql params from notebook

* default empty values

* rename

* parameterize notebook image

* remove pip installs from notebook

* use custom notebook image

* terraform fmt

* replace jupyter notebook tag

* add notebook version to jupyterhub app

* merge cells

* add dummy value for secret volume

* fix old notebook
In work example; full end-to-end testing with correct model engine still in progress
Example GKE cluster create with gpu-operator
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants