Skip to content

Commit

Permalink
🔄 synced local 'skyvern/' with remote 'skyvern/'
Browse files Browse the repository at this point in the history
<!-- ELLIPSIS_HIDDEN -->

| 🚀 | This description was created by [Ellipsis](https://www.ellipsis.dev) for commit afb421b1830123c03fc5e5c5ee8ecb0ac24826e5  |
|--------|--------|

### Summary:
Cleaned up GPT-4 routers and added `model_info` field to Azure GPT router configurations.

**Key points**:
- Removed `get_llm_router_config_for_cloud` function and related configurations from `cloud/__init__.py` and `cloud/llm/router.py`.
- Added `model_info` field to `LLMRouterModelConfig` in `skyvern/forge/sdk/api/llm/models.py`.
- Updated `get_gpt_turbo_router_config`, `get_llm_router_config_for_gpt4o`, and `get_massive_llm_router_config_for_gpt4o` functions to include `model_info` field.
- Removed `ENABLE_AZURE_GPT4V_ROUTER` setting from `cloud/config.py`.
- Added `MAX_PARALLEL_REQUESTS` to massive Azure GPT-4O configurations in `cloud/config.py`.
- Updated `scripts/run_task.py` to use `get_llm_api_handler_with_router` for `massive-gpt4o` model.

----
Generated with ❤️ by [ellipsis.dev](https://www.ellipsis.dev)

<!-- ELLIPSIS_HIDDEN -->
  • Loading branch information
ykeremy committed Jul 18, 2024
1 parent 78a1bae commit 2141b19
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion skyvern/forge/sdk/api/llm/models.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
from dataclasses import dataclass
from dataclasses import dataclass, field
from typing import Any, Awaitable, Literal, Protocol

from skyvern.forge.sdk.models import Step
Expand Down Expand Up @@ -27,6 +27,7 @@ class LLMRouterModelConfig:
model_name: str
# https://litellm.vercel.app/docs/routing
litellm_params: dict[str, Any]
model_info: dict[str, Any] = field(default_factory=dict)
tpm: int | None = None
rpm: int | None = None

Expand Down

0 comments on commit 2141b19

Please sign in to comment.