Adds in a new threadpool called api. This is used to specify the number of threads used to handle API requests concurrently by the ASGI server. Also added in the configuration option api_concurrency_limit which specifies the maximum amount of concurrent requests to accept before requests are outright rejected.
Local Tests
Raising the api threadpool size allows for handling more API requests which depend on other api requests without locking up. Locking up still a possibility, but now possible to mitigate with a larger pool size here.
Closes kytos-ng/mef_eline#406
Summary
Adds in a new threadpool called
api. This is used to specify the number of threads used to handle API requests concurrently by the ASGI server. Also added in the configuration optionapi_concurrency_limitwhich specifies the maximum amount of concurrent requests to accept before requests are outright rejected.Local Tests
Raising the
apithreadpool size allows for handling more API requests which depend on other api requests without locking up. Locking up still a possibility, but now possible to mitigate with a larger pool size here.