quasiben / dask-scheduler-performance

BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

DGX Nightly Benchmark run 20210312 #125

Open quasiben opened 3 years ago

quasiben commented 3 years ago

Benchmark history

<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210312-benchmark-history.png">

Raw Data

<Client: 'tcp://127.0.0.1:40473' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.03.0+7.gbd65bef6 simple 4.129e-01 +/- 1.311e-01 shuffle 2.231e+01 +/- 1.238e+00 rand_access 9.235e-03 +/- 3.568e-03 anom_mean 1.092e+02 +/- 8.379e-01

Raw Values

simple [0.46283841 0.23052859 0.45694828 0.46599984 0.48360109 0.23461032 0.43728399 0.66962433 0.44016385 0.24720645] shuffle [21.20708585 23.49208069 21.08361006 21.12294674 24.07429385 21.45230985 22.58265519 24.5914216 21.73692989 21.71535015] rand_access [0.00784326 0.00962114 0.01064897 0.00969481 0.01066709 0.0111661 0.01044965 0.00332642 0.01581788 0.00311017] anom_mean [110.05891871 108.08714056 109.59347796 109.13610578 109.27017641 108.4659791 108.36192346 108.52227712 110.74237704 110.10129642]

Dask Profiles

Scheduler Execution Graph

<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210312-sched-graph.png">