[Feature]: backend support for Hugging Face #828
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Checklist
Is this feature request related to a problem?
None
Problem Description
No response
Solution Description
backend support for HF models.
users can use inference API of HF conversational model.
for HF interface, there are some packages like https://pkg.go.dev/github.com/hupe1980/go-huggingface
Benefits
using hf backend, k8sgpt users can use free llm api through hf.
also, sLLMs are good enought on k8s analyzing.
Potential Drawbacks
huggingfaces error: Model mistralai/Mistral-7B-v0.1 is currently loading
. So hf backend should be used to locally or when testing llm model.Additional Information
No response
The text was updated successfully, but these errors were encountered: