search

gnunicorn / clippy-service

Linting your rust project with clippy as a service
GNU Affero General Public License v3.0
36 stars 9 forks source link

Use queue & workers for building #15

Open gnunicorn opened 8 years ago

gnunicorn commented 8 years ago

Right now we spin up a new thread regardless of whether we have many processes running or only a few. We probably want to switch this to a process, which has x-workers run at the same time max (I am thinking 20-40 makes sense, depending on system resources) and have everything else queued up (potentially with redis).

gnunicorn commented 8 years ago

See http://redis.io/commands/blpop and http://flask.pocoo.org/snippets/73/

gnunicorn commented 8 years ago

Ok. this has more urgency than initially thought. taking a look at the logs, it appears #18 might also be caused by improper key locking: http://localhost:9099/github/sha/ligthyear/clippy-service/da9d0437da14335c9525f6337c1445109a4f4c09/log

gnunicorn commented 8 years ago

investigate usage of https://crates.io/crates/oppgave