Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210323-benchmark-history.png">
<Client: 'tcp://127.0.0.1:34667' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.03.0+22.g2ca82c01 simple 5.653e-01 +/- 2.819e-02 shuffle 2.775e+01 +/- 2.088e+00 rand_access 1.459e-02 +/- 1.259e-02 anom_mean 1.082e+02 +/- 1.462e+00
simple [0.56979805 0.54139622 0.5177581 0.52951218 0.60028652 0.58074642 0.56507068 0.5647274 0.56969071 0.61360503] shuffle [27.95517103 26.31068145 26.56002967 32.09061405 25.02927266 25.80638943 30.55723476 26.84784676 28.8809704 27.48835342] rand_access [0.00948068 0.00940035 0.01050852 0.01083578 0.01054282 0.01063542 0.00997696 0.0120705 0.01017979 0.05228633] anom_mean [107.76325505 108.24565658 108.10769936 106.42280182 107.99309418 108.33229485 106.84017018 109.34635637 111.78673699 106.80892501]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210323-sched-graph.png">
Benchmark history
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210323-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:34667' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.03.0+22.g2ca82c01 simple 5.653e-01 +/- 2.819e-02 shuffle 2.775e+01 +/- 2.088e+00 rand_access 1.459e-02 +/- 1.259e-02 anom_mean 1.082e+02 +/- 1.462e+00
Raw Values
simple [0.56979805 0.54139622 0.5177581 0.52951218 0.60028652 0.58074642 0.56507068 0.5647274 0.56969071 0.61360503] shuffle [27.95517103 26.31068145 26.56002967 32.09061405 25.02927266 25.80638943 30.55723476 26.84784676 28.8809704 27.48835342] rand_access [0.00948068 0.00940035 0.01050852 0.01083578 0.01054282 0.01063542 0.00997696 0.0120705 0.01017979 0.05228633] anom_mean [107.76325505 108.24565658 108.10769936 106.42280182 107.99309418 108.33229485 106.84017018 109.34635637 111.78673699 106.80892501]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210323-sched-graph.png">