From f359a7b8364f67d53bfbcc71cc1f68da345a8d18 Mon Sep 17 00:00:00 2001 From: Sina Semnani <60150701+s-jse@users.noreply.github.com> Date: Thu, 5 Sep 2024 11:28:02 -0700 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index fbda7a0..5375756 100644 --- a/README.md +++ b/README.md @@ -191,7 +191,7 @@ OPENAI_API_KEY=[Your OpenAI API key from https://platform.openai.com/api-keys] MISTRAL_API_KEY=[Your Mistral API key from https://console.mistral.ai/api-keys/] ``` -Note that locally hosted models do NOT need an API key, but you need to provide an OpenAI-compatible endpoint in `api_base`. The code has been tested with [🤗 Text Generation Inference](https://github.com/huggingface/text-generation-inference/) endpoints, but you can try other similar endpoints like [vLLM](https://github.com/vllm-project/vllm), [SGLang](https://github.com/sgl-project/sglang), etc. +Note that locally hosted models do NOT need an API key, but you need to provide an OpenAI-compatible endpoint in `api_base`. The code has been tested with [🤗 Text Generation Inference](https://github.com/huggingface/text-generation-inference/). ## Configure Information Retrieval