Add Groq - OpenAI Compatible API - details (#934)

crewAIInc · Jul 14, 2024 · 4eb4073 · 4eb4073
1 parent 7b53457
commit 4eb4073
Showing 1 changed file with 9 additions and 2 deletions.
diff --git a/docs/how-to/LLM-Connections.md b/docs/how-to/LLM-Connections.md
@@ -127,7 +127,7 @@ llm = HuggingFaceHub(
 ```
 
 ## OpenAI Compatible API Endpoints
-Switch between APIs and models seamlessly using environment variables, supporting platforms like FastChat, LM Studio, and Mistral AI.
+Switch between APIs and models seamlessly using environment variables, supporting platforms like FastChat, LM Studio, Groq, and Mistral AI.
 
 ### Configuration Examples
 #### FastChat
@@ -144,6 +144,13 @@ OPENAI_API_BASE="http://localhost:1234/v1"
 OPENAI_API_KEY="lm-studio"
 ```
 
+#### Groq API
+```sh
+OPENAI_API_KEY=your-groq-api-key
+OPENAI_MODEL_NAME='llama3-8b-8192'
+OPENAI_API_BASE=https://api.groq.com/openai/v1
+```
+
 #### Mistral API
 ```sh
 OPENAI_API_KEY=your-mistral-api-key
@@ -211,4 +218,4 @@ azure_agent = Agent(
 ```
 
 ## Conclusion
-Integrating CrewAI with different LLMs expands the framework's versatility, allowing for customized, efficient AI solutions across various domains and platforms.
+Integrating CrewAI with different LLMs expands the framework's versatility, allowing for customized, efficient AI solutions across various domains and platforms.