Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201226-benchmark-history.png">
<Client: 'tcp://127.0.0.1:37233' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+11.g4386b756 simple 5.682e-01 +/- 3.91e-02 shuffle 2.202e+01 +/- 4.905e-01 rand_access 1.037e-02 +/- 1.176e-03 anom_mean 9.971e+01 +/- 9.277e-01
simple [0.56352639 0.55532575 0.57980347 0.55326962 0.59731746 0.5648241 0.61056638 0.59040356 0.46570873 0.60121489] shuffle [21.45807004 21.25152564 21.8501904 21.44671202 22.13269734 22.13916731 22.11207104 22.44060636 22.48860788 22.86279464] rand_access [0.00795054 0.00986099 0.01201153 0.01033282 0.01016808 0.01114511 0.00929761 0.01185703 0.01123333 0.00984621] anom_mean [ 99.49055672 98.95810461 101.9219172 99.08124375 98.73804402 99.32295918 100.17971134 99.28560781 100.75222969 99.35889959]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201226-sched-graph.png">
Historical Throughput
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201226-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:37233' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+11.g4386b756 simple 5.682e-01 +/- 3.91e-02 shuffle 2.202e+01 +/- 4.905e-01 rand_access 1.037e-02 +/- 1.176e-03 anom_mean 9.971e+01 +/- 9.277e-01
Raw Values
simple [0.56352639 0.55532575 0.57980347 0.55326962 0.59731746 0.5648241 0.61056638 0.59040356 0.46570873 0.60121489] shuffle [21.45807004 21.25152564 21.8501904 21.44671202 22.13269734 22.13916731 22.11207104 22.44060636 22.48860788 22.86279464] rand_access [0.00795054 0.00986099 0.01201153 0.01033282 0.01016808 0.01114511 0.00929761 0.01185703 0.01123333 0.00984621] anom_mean [ 99.49055672 98.95810461 101.9219172 99.08124375 98.73804402 99.32295918 100.17971134 99.28560781 100.75222969 99.35889959]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201226-sched-graph.png">