search

quasiben / dask-scheduler-performance

BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

DGX Nightly Benchmark run 20210402 #133

Open quasiben opened 3 years ago

quasiben commented 3 years ago

Benchmark history

<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210402-benchmark-history.png">

Raw Data

<Client: 'tcp://127.0.0.1:36573' processes=10 threads=10, memory=503.79 GiB> Distributed Version: 2021.04.0 simple 5.133e-01 +/- 3.015e-02 shuffle 2.278e+01 +/- 9.577e-01 rand_access 1.026e-02 +/- 1.154e-03 anom_mean 1.032e+02 +/- 1.136e+00

Raw Values

simple [0.52372798 0.51874325 0.51138763 0.49053126 0.55328659 0.53017979 0.56643282 0.46770999 0.49147569 0.47909195] shuffle [21.12231356 22.52451041 21.6214508 24.09851612 24.01578618 23.88553275 22.33656675 23.11626018 22.31331001 22.79680096] rand_access [0.00740168 0.01041125 0.01076836 0.01100344 0.00970448 0.00951812 0.01199817 0.01033892 0.01079087 0.01063 ] anom_mean [101.9081098 102.58186312 103.02682409 105.3180839 102.59476113 102.52342434 105.39732678 103.43423816 102.44427163 102.93056833]

Dask Profiles

Scheduler Execution Graph

<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210402-sched-graph.png">