2. Services

Frontends

This section covers services that can provide you with an interface for interacting with the language models.

• Open WebUI

• ComfyUI

• LibreChat

• HuggingFace ChatUI

• Lobe Chat

• hollama

• parllama

• BionicGPT

• AnythingLLM

• Chat Nio

Backends

This section covers services that provide the LLM inference capabilities.

• Ollama

• llama.cpp

• vLLM

• TabbyAPI

• Aphrodite Engine

• mistral.rs

• openedai-speech

• Parler

• text-generation-inference

• lmdeploy

• AirLLM

• SGLang

• ktransformers

• Whisper

• Nexa SDK

Satellite services

Additional services that can be integrated with various Frontends and Backends to enable more features.

• SearXNG

• Perplexica

• Dify

• Plandex

• 🚅 LiteLLM

• langfuse

• ● Open Interpreter

• cloudflared

• cmdh

• fabric

• txtai RAG

• TextGrad

• aider

• aichat

• autogpt

• omnichain

• Harbor Bench

• lm-evaluation-harness

• JupyterLab

• ol1

• Harbor Boost

• OpenHands

• LitLytics

• Repopack

• n8n

• Bolt.new

• Open WebUI Pipelines

• Qdrant

• K6

• Promptfoo