Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210208-benchmark-history.png">
<Client: 'tcp://127.0.0.1:45281' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.02.0+1.g7d2a22f9 simple 5.76e-01 +/- 4.529e-02 shuffle 2.316e+01 +/- 1.576e+00 rand_access 1.168e-02 +/- 2.733e-03 anom_mean 1.166e+02 +/- 6.459e+00
simple [0.63365412 0.57301211 0.57702041 0.56734514 0.63669109 0.55739903 0.59183979 0.60132647 0.55360603 0.46791244] shuffle [19.52558374 22.49100542 24.20904684 23.9014976 24.28669381 21.57441545 22.28524876 24.11100483 24.48009324 24.68839383] rand_access [0.01246357 0.01964688 0.0107038 0.00977063 0.01102471 0.01084328 0.01080775 0.01030397 0.01070881 0.01054525] anom_mean [117.69052219 125.02509356 112.32200599 113.36493778 113.02955151 113.05427909 132.28176475 111.45427918 114.39282179 112.90445042]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210208-sched-graph.png">
Benchmark history
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210208-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:45281' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.02.0+1.g7d2a22f9 simple 5.76e-01 +/- 4.529e-02 shuffle 2.316e+01 +/- 1.576e+00 rand_access 1.168e-02 +/- 2.733e-03 anom_mean 1.166e+02 +/- 6.459e+00
Raw Values
simple [0.63365412 0.57301211 0.57702041 0.56734514 0.63669109 0.55739903 0.59183979 0.60132647 0.55360603 0.46791244] shuffle [19.52558374 22.49100542 24.20904684 23.9014976 24.28669381 21.57441545 22.28524876 24.11100483 24.48009324 24.68839383] rand_access [0.01246357 0.01964688 0.0107038 0.00977063 0.01102471 0.01084328 0.01080775 0.01030397 0.01070881 0.01054525] anom_mean [117.69052219 125.02509356 112.32200599 113.36493778 113.02955151 113.05427909 132.28176475 111.45427918 114.39282179 112.90445042]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210208-sched-graph.png">