Can the number of gunicorn threads be changed easily?

MultiQC / MegaQC

Web application to collect and visualise data across multiple MultiQC runs.

http://megaqc.info/

GNU General Public License v3.0

95 stars 28 forks source link

Can the number of gunicorn threads be changed easily? #475

Open eandersonIGS opened 1 year ago

eandersonIGS commented 1 year ago

Question

When I run MegaQC using docker-compose on a server with a higher core count (48 cores / 256GB RAM) it attempts to spawn too many gunicorn threads and crashes with a memory error. I have gotten around this by mounting a modified gunicorn_conf.py over top of the existing one in the container. Is there another way to set the number of gunicorn threads?

multimeric commented 1 year ago

Hi @eandersonIGS. Currently we're using the tiangolo/meinheld-gunicorn-flask image, which I believe you can configure using environment variables, e.g. https://github.com/tiangolo/meinheld-gunicorn-flask-docker#workers_per_core. You can either provide these variables by editing the compose file, or on the CLI: https://docs.docker.com/compose/environment-variables/set-environment-variables/.