search

chenfei-wu / TaskMatrix

Other
34.53k stars 3.33k forks source link

Add support for multiple azure deployments #451

Open krrishdholakia opened 10 months ago

krrishdholakia commented 10 months ago

Hey @chenfei-wu @jordddan,

This PR adds support for letting users call across multiple Azure deployments. It uses LiteLLM's Router to manage across rate limits, to prevent requests from failing in prod.