search

Azure / azure-openai-benchmark

Azure OpenAI benchmarking tool
MIT License
130 stars 54 forks source link

Set unlimited TCP connections for aiohttp #8

Closed technicianted closed 1 year ago

technicianted commented 1 year ago

By default, aiohttp sets a maximum number of concurrent TCP connections to 100. Since it works with http1.1, at high load this may run out very quickly and cause queuing.

This PR removes the limit.