2. Services

Frontends

This section covers services that can provide you with an interface for interacting with the language models.

---

Open WebUI

---

ComfyUI

---

LibreChat

---

HuggingFace ChatUI

---

Lobe Chat

---

hollama

---

parllama

---

BionicGPT

---

AnythingLLM

---

Backends

This section covers services that provide the LLM inference capabilities.

---

Ollama

---

llama.cpp

---

vLLM

---

TabbyAPI

---

Aphrodite Engine

---

mistral.rs

---

openedai-speech

---

Parler

---

text-generation-inference

---

lmdeploy

---

AirLLM

---

SGLang

---

ktransformers

---

Whisper

Satellite services

Additional services that can be integrated with various Frontends and Backends to enable more features.

---

SearXNG

---

Perplexica

---

Dify

---

Plandex

---

🚅 LiteLLM

---

langfuse

---

● Open Interpreter

---

cloudflared

---

cmdh

---

fabric

---

txtai RAG

---

TextGrad

---

aider

---

aichat

---

autogpt

---

omnichain

---

Harbor Bench

---

lm-evaluation-harness

---

JupyterLab

---

ol1

---

Harbor Boost

---

OpenHands

---

LitLytics