Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Local AI API Platform

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage graphRAG / RAG

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Interface for OuteTTS models.

Practical Llama 3 inference in Java

Effortlessly run LLM backends, APIs, frontends, and services with one command.

An open source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI artifact.

Go manage your Ollama models

Run AI ✨ assistant locally! with simple API for Node.js 🚀

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

Go library for embedded vector search and semantic embeddings using llama.cpp

GGUF implementation in C as a library and a tools CLI program

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs

Making offline AI models accessible to all types of edge devices.

Gradio based tool to run opensource LLM models directly from Huggingface

Own your AI, search the web with it🌐😎