Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mechanism for setting aliases for models #4

Closed
simonw opened this issue Aug 12, 2023 · 3 comments
Closed

Mechanism for setting aliases for models #4

simonw opened this issue Aug 12, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@simonw
Copy link
Owner

simonw commented Aug 12, 2023

Maybe a -a/--alias option that can be passed zero or more times to the llm mlc download-model command.

It would be useful to apply aliases later as well, but I think that's a feature that should go in LLM itself.

@simonw simonw added the enhancement New feature or request label Aug 12, 2023
@simonw
Copy link
Owner Author

simonw commented Aug 12, 2023

I'm going to depend on LLM 0.7 or higher and have the download-model ... --alias llama2 option work by writing to the aliases.json file.

@simonw
Copy link
Owner Author

simonw commented Aug 13, 2023

I just noticed that this:

llm mlc download-model Llama-2-7b-chat

Results in a model activated like this:

llm -m mlc-chat-Llama-2-7b-chat-hf-q4f16_1 \
  'five names for a cute pet ferret'

It should set up Llama-2-7b-chat as an alias automatically too.

@simonw simonw closed this as completed in 7b743ad Aug 13, 2023
@simonw
Copy link
Owner Author

simonw commented Aug 13, 2023

simonw added a commit that referenced this issue Aug 14, 2023
Refs #4, #6, #7, #9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant