Skip to content

Commit

Permalink
chore: FAQ Question on PreferredNodes addition (#545)
Browse files Browse the repository at this point in the history
**Reason for Change**:
Add faq question for `How do I ensure preferred nodes are correctly
labeled for use in my workspace?`
  • Loading branch information
ishaansehgal99 authored Aug 1, 2024
1 parent c54af47 commit 39eb92f
Showing 1 changed file with 11 additions and 0 deletions.
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,17 @@ Starting with version v0.3.0, Kaito supports model fine-tuning and using fine-tu

## FAQ

### How do I ensure preferred nodes are correctly labeled for use in my workspace?

For using preferred nodes, make sure the node has the label specified in the labelSelector
under matchLabels. For example, if your labelSelector is:
```
labelSelector:
matchLabels:
apps: falcon-7b
```
Then the node should have the label: `apps=falcon-7b`.

### How to upgrade the existing deployment to use the latest model configuration?

When using hosted public models, a user can delete the existing inference workload (`Deployment` of `StatefulSet`) manually, and the workspace controller will create a new one with the latest preset configuration (e.g., the image version) defined in the current release. For private models, it is recommended to create a new workspace with a new image version in the Spec.
Expand Down

0 comments on commit 39eb92f

Please sign in to comment.