search

Azure-Samples / openai-aca-lb

Smart load balancing for Azure OpenAI endpoints
MIT License
40 stars 17 forks source link

load balance between fine tuned endpoints #18

Open mayank-rakesh-mck opened 3 months ago

mayank-rakesh-mck commented 3 months ago

@andredewes How Can we load balance between fine-tuned endpoints because each fine tune endpoint has a different name in a different instance? Can you help regarding this?