freelawproject / doctor

A microservice for document conversion at scale
https://free.law/projects/doctor
BSD 2-Clause "Simplified" License
57 stars 15 forks source link

Gunicorn only has one worker and thus not much performance #130

Closed mlissner closed 2 years ago

mlissner commented 2 years ago

I might be wrong about this, but....Sentry isn't very happy with us right now because, unless I'm missing something, Doctor's gunicorn config is set up with only one worker to serve requests:

https://github.com/freelawproject/doctor/blob/main/docker/docker-entrypoint.sh#L2

In CL, we have 48 workers configured to serve the website, and Doctor certainly needs more than one, particularly since it's often tied up with tesseract stuff.

Here's the config: https://docs.gunicorn.org/en/stable/settings.html#workers

The Sentry issue is: COURTLISTENER-2BA

It's triggering now because we doing a lot of crawling at the moment.