Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210330-benchmark-history.png">
<Client: 'tcp://127.0.0.1:39861' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.03.1+6.ge8c8e351 simple 4.995e-01 +/- 2.215e-02 shuffle 2.281e+01 +/- 1.221e+00 rand_access 1.036e-02 +/- 1.144e-03 anom_mean 1.003e+02 +/- 2.418e+00
simple [0.500507 0.47923217 0.47438697 0.47201837 0.54957954 0.5231459 0.49413574 0.50223931 0.50122776 0.49840746] shuffle [23.02526012 21.39588407 21.74193093 22.33409168 22.7255655 26.12062196 23.10051795 22.33451578 22.98871576 22.37890417] rand_access [0.00748232 0.0116772 0.01031759 0.00939677 0.01163295 0.01068891 0.01024959 0.01069052 0.01075299 0.01073815] anom_mean [ 99.28002207 99.20842401 100.61713576 102.84866317 97.52334732 98.51454276 99.27332903 106.1947987 100.55639407 98.59531959]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210330-sched-graph.png">
Benchmark history
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210330-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:39861' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.03.1+6.ge8c8e351 simple 4.995e-01 +/- 2.215e-02 shuffle 2.281e+01 +/- 1.221e+00 rand_access 1.036e-02 +/- 1.144e-03 anom_mean 1.003e+02 +/- 2.418e+00
Raw Values
simple [0.500507 0.47923217 0.47438697 0.47201837 0.54957954 0.5231459 0.49413574 0.50223931 0.50122776 0.49840746] shuffle [23.02526012 21.39588407 21.74193093 22.33409168 22.7255655 26.12062196 23.10051795 22.33451578 22.98871576 22.37890417] rand_access [0.00748232 0.0116772 0.01031759 0.00939677 0.01163295 0.01068891 0.01024959 0.01069052 0.01075299 0.01073815] anom_mean [ 99.28002207 99.20842401 100.61713576 102.84866317 97.52334732 98.51454276 99.27332903 106.1947987 100.55639407 98.59531959]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210330-sched-graph.png">