diff --git a/docs/source/use-cases/index.rst b/docs/source/use-cases/index.rst index 00118e1496b..0ca6ea6aa63 100644 --- a/docs/source/use-cases/index.rst +++ b/docs/source/use-cases/index.rst @@ -41,23 +41,31 @@ See the following lists for a complete collection of BentoML example projects. B LLMs ---- -Serve LLMs with BentoML and vLLM: +Deploy an OpenAI-compatible LLM API service: - `Llama 3.2 90B `_ - `Llama 3.1 70B `_ - `Mistral 7B `_ - `Pixtral 12B `_ - `Phi 3 mini `_ -- Check out the `BentoVLLM project `_ to see more examples -Build compound AI systems on top of LLMs: +Choose your LLM Inference runtime: -- `Build an AI agent with function calling using BentoML `_ -- `Build a LangGraph agent application with BentoML `_ -- `Build a multi-agent application with CrewAI and BentoML `_ -- `Build an AI assistant to ensure LLM safety with BentoML and ShieldGemma `_ -- `Build a RAG system for document ingestion and search with LlamaIndex and BentoML `_ -- `Build a voice agent with open-source models using Twilio, Pipecat and BentoML `_ +- `vLLM `_ (or `OpenLLM `_) +- `TensorRT-LLM `_ +- `LMDeploy `_ +- `MLC-LLM `_ +- `SGLang `_ +- `Hugging Face TGI `_ + +Advanced examples: + +- `Agent: Function calling `_ +- `Agent: LangGraph `_ +- `Multi-agent: CrewAI `_ +- `LLM safety: ShieldGemma `_ +- `RAG: LlamaIndex `_ +- `Phone call agent `_ Image and video ---------------