gguf

Here are 3 public repositories matching this topic...

run ollama & gguf easily with a single command

inference openai llama lora mistral llm llm-inference ollama gguf autoollama autogguf mergelora

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

android ai termux mamba mistral phi vicuna koboldai rwkv llamacpp ggml rwkv4 koboldcpp gguf tinyllama rwkvcpp tinyvicuna tinydolphin

Zero-G is an open-source, robust artificial intelligence platform.

ai open artificial-intelligence llama gpt bangladesh llm llama-index ollama gguf ollama-client zro-g

Add a description, image, and links to the gguf topic page so that developers can more easily learn about it.

To associate your repository with the gguf topic, visit your repo's landing page and select "manage topics."