search

lightster / hodor

🚪 A worker queue that is evolving to a job queue
MIT License
4 stars 1 forks source link

Only superqueue up to 250 jobs in one batch #98

Closed lightster closed 8 years ago

lightster commented 8 years ago

Previously, batches could become too huge to handle in-memory

lightster commented 8 years ago

@Twenty7: this builds on the other pull request I accidentally merged in. Rather than superqueueing all jobs in one batch, we are queueing 250 jobs instead. The number is a bit arbitrary, but we can change it later if we have data to support a better number.

How does the change look to you?