search

binarymatt / pyres

a resque clone in python
http://github.com/binarydud/pyres
MIT License
955 stars 130 forks source link

Start multiple workers #11

Closed yashh closed 14 years ago

yashh commented 14 years ago

Is there a way to start multiple workers.

$ ./pyres_worker queue1, queue2

Seems to start a worker which checks queue1, queue2 and sleep for 5. In production we need to have ability to start multiple workers / queue basis and keep the process under supervisord or some process monitor

binarymatt commented 14 years ago

Can you not kick of multiple workers right now with something like nohup and backgrounding the process? I started a prefork version of worker that will have a master process that spawns off multple children that each process jobs and are not killed after every job. Hopefully I will get back to work on that now that I've finished the first version of the failure backends module.

binarymatt commented 14 years ago

i'm closing this for now because you can start multiple workers using the pyres_worker command. Also, the horde branch is now pushed up for testing. It uses multiprocessing to allow for managing multiple workers.