In the case of multiple incoming requests, to maintain good service for each compilation, it would be good to have a limit on the maximum number of docker containers spawned at any moment of time. This would lead to the requirement of a fifo queue for scheduling the compilation requests.
In the case of multiple incoming requests, to maintain good service for each compilation, it would be good to have a limit on the maximum number of docker containers spawned at any moment of time. This would lead to the requirement of a fifo queue for scheduling the compilation requests.