Default capacity is 1, readme should mention

Azure-Samples / openai-aca-lb

Smart load balancing for Azure OpenAI endpoints

MIT License

40 stars 17 forks source link

Default capacity is 1, readme should mention #10

Closed pamelafox closed 4 months ago

pamelafox commented 6 months ago

Its only deploying 1K TPM so everyone will need to increase. Readme and tutorial should describe how and link to the learn doc about quotas being per region/model. CC @diberry

andredewes commented 4 months ago

Changed to 30