search

Ecotrust / cogs-priorities

national-scale refuge planning tool
Other
1 stars 1 forks source link

celery seems limited to a single CPU [2 days] #14

Closed perrygeo closed 10 years ago

perrygeo commented 10 years ago

concurrency working or not?

perrygeo commented 10 years ago

This is a tricky issue but critical to performance. Running celeryd in the shell with -c 5 and concurrently firing off 5 tasks shows each Marxan process taking 20% of a single CPU, not 100 * cores/5% as expected

perrygeo commented 10 years ago

http://stackoverflow.com/questions/23552468/cpu-concurrency-behavior-with-celery-task-that-calls-a-subprocess