AmineDiro / daskqueue

Distributed Task Queue based Dask
MIT License
35 stars 0 forks source link

Perfomance : changed batch submit and consumer get logic #12

Closed AmineDiro closed 2 years ago

AmineDiro commented 2 years ago

After running benchmarks on the current implementation, the scheduling algorithm changed for the following:

This changes are a result of running several benchmark and tests.

We aim to have as much performance measured in : high throughput, low submit_time and work_time.