LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage graphRAG / RAG

Interface for OuteTTS models.

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs

Gradio based tool to run opensource LLM models directly from Huggingface

Own your AI, search the web with it🌐😎

Download models from the Ollama library, without Ollama

Extract structured data from local or remote LLM models

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

A collection of cog models for use on Replicate

Some random tools for working with the GGUF file format

convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible

SpeakingAI is a demo of privately deployable 'GPT-4o like AI + RAG', a fully functional web AI server with audio query/answer in streaming, using LLM and RAG for backend knowledge.

Auto Complete anything using a gguf model

run flux1/sd3 model with beginner GPU (low cost) or even CPU

your go-to tool for easily creating quantized versions of Hugging Face models in the GGUF format.

My AI Assistant is an open source virtual assistant chatbot built with Python. It allows you to have natural conversations by text or voice.

Wrapper for simplified use of Llama2 GGUF quantized models.

glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama models quantized to GGUF format. APIs for downloading and loading models automatically, includes a db with models of various scale and quantizations. With this high level API you need one line to load the model and one to generate text completions.

Simple large language model playground app