Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201222-benchmark-history.png">
<Client: 'tcp://127.0.0.1:36025' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+9.g976e02eb simple 5.379e-01 +/- 3.622e-02 shuffle 2.241e+01 +/- 9.686e-01 rand_access 1.013e-02 +/- 7.723e-04 anom_mean 9.776e+01 +/- 1.260e+00
simple [0.56699324 0.51083088 0.51280737 0.51236773 0.5212338 0.58478451 0.5538075 0.46915269 0.58540201 0.5612452 ] shuffle [21.07223582 24.32067394 21.85259223 21.22643065 21.80941033 22.33910728 22.21091843 23.32506609 23.3966372 22.52647781] rand_access [0.00846505 0.01017785 0.01018786 0.0097909 0.00965643 0.01148343 0.00988746 0.01094341 0.01067209 0.01008224] anom_mean [ 96.39146018 96.07690501 100.66984701 98.803128 97.14130306 97.8827951 97.64390111 98.51409936 97.51079726 96.99614263]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201222-sched-graph.png">
Historical Throughput
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20201222-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:36025' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+9.g976e02eb simple 5.379e-01 +/- 3.622e-02 shuffle 2.241e+01 +/- 9.686e-01 rand_access 1.013e-02 +/- 7.723e-04 anom_mean 9.776e+01 +/- 1.260e+00
Raw Values
simple [0.56699324 0.51083088 0.51280737 0.51236773 0.5212338 0.58478451 0.5538075 0.46915269 0.58540201 0.5612452 ] shuffle [21.07223582 24.32067394 21.85259223 21.22643065 21.80941033 22.33910728 22.21091843 23.32506609 23.3966372 22.52647781] rand_access [0.00846505 0.01017785 0.01018786 0.0097909 0.00965643 0.01148343 0.00988746 0.01094341 0.01067209 0.01008224] anom_mean [ 96.39146018 96.07690501 100.66984701 98.803128 97.14130306 97.8827951 97.64390111 98.51409936 97.51079726 96.99614263]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20201222-sched-graph.png">