search

Azure / azure-openai-benchmark

Azure OpenAI benchmarking tool
MIT License
118 stars 51 forks source link

Set unlimited TCP connections for aiohttp #8

Closed technicianted closed 10 months ago

technicianted commented 10 months ago

By default, aiohttp sets a maximum number of concurrent TCP connections to 100. Since it works with http1.1, at high load this may run out very quickly and cause queuing.

This PR removes the limit.