Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201218-benchmark-history.png">
<Client: 'tcp://127.0.0.1:38217' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+8.g3fb3d8c8 simple 5.649e-01 +/- 3.873e-02 shuffle 2.209e+01 +/- 8.19e-01 rand_access 1.059e-02 +/- 1.04e-03 anom_mean 1.e+02 +/- 7.894e-01
simple [0.60526943 0.54414678 0.54939461 0.57793164 0.54464912 0.61450505 0.59779644 0.47296596 0.56636882 0.57597065] shuffle [21.14644217 21.39722776 21.72356105 21.13798904 21.8924849 22.32281971 22.09488916 23.9469533 22.29553437 22.93400383] rand_access [0.00764656 0.01096177 0.01114845 0.0110302 0.01155615 0.01041889 0.01123023 0.01033831 0.01074266 0.01080871] anom_mean [ 99.35177994 98.83628511 99.18101597 99.98170042 99.76559329 101.29038143 99.88842654 100.18160772 101.42053485 100.05713606]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201218-sched-graph.png">
Historical Throughput
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201218-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:38217' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+8.g3fb3d8c8 simple 5.649e-01 +/- 3.873e-02 shuffle 2.209e+01 +/- 8.19e-01 rand_access 1.059e-02 +/- 1.04e-03 anom_mean 1.e+02 +/- 7.894e-01
Raw Values
simple [0.60526943 0.54414678 0.54939461 0.57793164 0.54464912 0.61450505 0.59779644 0.47296596 0.56636882 0.57597065] shuffle [21.14644217 21.39722776 21.72356105 21.13798904 21.8924849 22.32281971 22.09488916 23.9469533 22.29553437 22.93400383] rand_access [0.00764656 0.01096177 0.01114845 0.0110302 0.01155615 0.01041889 0.01123023 0.01033831 0.01074266 0.01080871] anom_mean [ 99.35177994 98.83628511 99.18101597 99.98170042 99.76559329 101.29038143 99.88842654 100.18160772 101.42053485 100.05713606]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201218-sched-graph.png">