Closed ykeremy closed 1 month ago
Cleaned up GPT-4 routers and added model_info field to Azure GPT router configurations.
model_info
Key points:
get_llm_router_config_for_cloud
cloud/__init__.py
cloud/llm/router.py
LLMRouterModelConfig
skyvern/forge/sdk/api/llm/models.py
get_gpt_turbo_router_config
get_llm_router_config_for_gpt4o
get_massive_llm_router_config_for_gpt4o
ENABLE_AZURE_GPT4V_ROUTER
cloud/config.py
MAX_PARALLEL_REQUESTS
scripts/run_task.py
get_llm_api_handler_with_router
massive-gpt4o
Generated with :heart: by ellipsis.dev
Summary:
Cleaned up GPT-4 routers and added
model_infofield to Azure GPT router configurations.Key points:
get_llm_router_config_for_cloudfromcloud/__init__.pyandcloud/llm/router.py.model_infofield toLLMRouterModelConfiginskyvern/forge/sdk/api/llm/models.py.get_gpt_turbo_router_config,get_llm_router_config_for_gpt4o, andget_massive_llm_router_config_for_gpt4oto includemodel_info.ENABLE_AZURE_GPT4V_ROUTERfromcloud/config.py.MAX_PARALLEL_REQUESTSto massive Azure GPT-4O configurations incloud/config.py.scripts/run_task.pyto useget_llm_api_handler_with_routerformassive-gpt4o.Generated with :heart: by ellipsis.dev