search

chrisboulton / php-resque

PHP port of resque (Workers and Queueing)
MIT License
3.43k stars 759 forks source link

Workers not picking up enqued jobs #263

Open raajeshnew opened 9 years ago

raajeshnew commented 9 years ago

urgent help requested

we use resque for batch uploads -- latest of symphony , doctrine and connected to elastic redis

we have created a default q with 10 worker threads. we split the uploads into a batch of 30 and if there are 10000 jobs so many batches need to run

Issue is when there are large job uploads the workers dont pick up some of the enqued jobs leaviong them in a state of limbo.

any thing in config needs to be done

IvoPereira commented 8 years ago

I'm having a similar issue.

Redis gets the jobs, however the Worker does randomly pick them. I can't really understand what's happening.

Have you ever figured it out @raajeshnew ?

jyothu commented 7 years ago

I'm also facing the same issue, I have 5 workers running. Still only one job is running at a time.