quasiben / dask-scheduler-performance

BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

DGX Nightly Benchmark run 20210126 #96

Open quasiben opened 3 years ago

quasiben commented 3 years ago

Benchmark history

<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210126-benchmark-history.png">

Raw Data

<Client: 'tcp://127.0.0.1:37117' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2021.01.1+5.gb5c36b58 simple 5.737e-01 +/- 3.685e-02 shuffle 2.285e+01 +/- 1.087e+00 rand_access 7.115e-03 +/- 3.397e-03 anom_mean 1.067e+02 +/- 2.448e+00

Raw Values

simple [0.58087111 0.56088114 0.59210324 0.56620884 0.56049871 0.63486314 0.48607492 0.61070681 0.57368422 0.57115269] shuffle [22.13689637 23.09469414 20.95687056 23.21751666 23.86801863 22.89592004 24.46283317 21.27262044 22.55320525 23.99396133] rand_access [0.00980377 0.00484395 0.00392962 0.01046157 0.00388193 0.00562763 0.00394869 0.00474381 0.01015091 0.01375604] anom_mean [105.98701072 107.33175182 104.38499045 107.71145248 104.64174676 105.39008069 112.33446741 105.24372983 104.5855608 109.59243298]

Dask Profiles

Scheduler Execution Graph

<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210126-sched-graph.png">