Closed chromium7 closed 7 months ago
some more manual testing with more jobs and multiple queues
rqworker | rqpool | rqpool | |
---|---|---|---|
Number of Worker | 4 | 4 | 16 |
Number of Jobs | 5500 | 5500 | 5500 |
Time Elapsed | 51.016926s(per worker) | 49.156525s | 30.708005s |
Peak Memory Usage | 0.574323MB (per worker) | 0.23773MB | 0.264708MB |
$ python manage.py rqworker default low medium --burst --verbosity 0 & \
python manage.py rqworker default low medium --burst --verbosity 0 & \
python manage.py rqworker default low medium --burst --verbosity 0 & \
python manage.py rqworker default low medium --burst --verbosity 0
Function Name : handle
Current memory usage: 0.4393MB
Peak : 0.574323MB
Duration : 51.016926s
Function Name : handle
Current memory usage: 0.439487MB
Peak : 0.57451MB
Duration : 51.103177s
Function Name : handle
Current memory usage: 0.439599MB
Peak : 0.574622MB
Duration : 51.239900s
Function Name : handle
Current memory usage: 0.43938MB
Peak : 0.574456MB
Duration : 51.193902s
$ python manage.py rqworker-pool default low medium --num-workers 4 --verbosity 0 --burst
Function Name : handle
Current memory usage: 0.185496MB
Peak : 0.23773MB
Duration : 49.156525s
$ python manage.py rqworker-pool default low medium --num-workers 16 --verbosity 0 --burst
Function Name : handle
Current memory usage: 0.192702MB
Peak : 0.264708MB
Duration : 30.708005s
Ref #621
Manual testing done:
x
number of jobsResult Summary
Result Details
1000 jobs, rqworker * 4
1000 jobs, rqpool with 4 workers
1000 jobs, rqpool with 8 workers
1000 jobs, rqpool with 24 workers