search

bee-queue / bee-queue

A simple, fast, robust job/task queue for Node.js, backed by Redis.
Other
3.79k stars 218 forks source link

Add Redis resource utilization benchmarks #67

Open skeggse opened 7 years ago

skeggse commented 7 years ago

We updated the benchmarks to show throughput for job processing across different job queues, but didn't instrument or compare their Redis utilization. We should do that.

manast commented 7 years ago

I recommend you do that after this PR is merged: https://github.com/OptimalBits/bull/pull/641

skeggse commented 7 years ago

Some related results: #69. Unfortunately not a complete Redis util benchmark.

See also: results-2017-08-12.json

bradvogel commented 7 years ago

Thanks for adding. So it looks like based on the raw results, Bee Queue is still roughly 2x faster than Bull 3.0rc5. Cc @manast

manast commented 7 years ago

@bradvogel hmm, more like 1.5x I would say. I am quite happy with the results so far. The concurrency issue is gone which was the most important issue in 3.0.

manast commented 7 years ago

Btw. something to consider. Bull has many more .lua files than bq to read and compile when it starts. This time is also computed in the test, could add 0.5 to 1 second to the total benchmark time.

bradvogel commented 7 years ago

Youre right - about 1.5x. Not sure about the startup time, but that could have also influenced the tests. Looks like Bull 3rc5 is getting close, and has just fine performance for 99% of queue use cases.