Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210111-benchmark-history.png">
<Client: 'tcp://127.0.0.1:34797' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+21.g658fccc3 simple 5.550e-01 +/- 5.271e-02 shuffle 2.173e+01 +/- 6.227e-01 rand_access 1.216e-02 +/- 6.424e-03 anom_mean 9.662e+01 +/- 1.197e+00
simple [0.60037899 0.50769925 0.5584836 0.52023911 0.52661395 0.63386083 0.6011889 0.60745645 0.53991246 0.45435309] shuffle [21.5329318 21.13219404 20.74173641 21.38218784 21.75490284 22.33604813 21.97238874 21.58965135 21.70288229 23.12169027] rand_access [0.00777435 0.01087284 0.01044869 0.03031206 0.00495744 0.0130384 0.01217723 0.01089001 0.01045156 0.01069283] anom_mean [97.06254244 98.42296362 94.31041813 95.28002095 97.58088207 98.02329898 96.84628725 96.36261606 96.56668687 95.75615549]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210111-sched-graph.png">
Benchmark history
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210111-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:34797' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+21.g658fccc3 simple 5.550e-01 +/- 5.271e-02 shuffle 2.173e+01 +/- 6.227e-01 rand_access 1.216e-02 +/- 6.424e-03 anom_mean 9.662e+01 +/- 1.197e+00
Raw Values
simple [0.60037899 0.50769925 0.5584836 0.52023911 0.52661395 0.63386083 0.6011889 0.60745645 0.53991246 0.45435309] shuffle [21.5329318 21.13219404 20.74173641 21.38218784 21.75490284 22.33604813 21.97238874 21.58965135 21.70288229 23.12169027] rand_access [0.00777435 0.01087284 0.01044869 0.03031206 0.00495744 0.0130384 0.01217723 0.01089001 0.01045156 0.01069283] anom_mean [97.06254244 98.42296362 94.31041813 95.28002095 97.58088207 98.02329898 96.84628725 96.36261606 96.56668687 95.75615549]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210111-sched-graph.png">