Open quasiben opened 3 years ago
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210107-benchmark-history.png">
<Client: 'tcp://127.0.0.1:44033' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+17.g49e19c01 simple 5.559e-01 +/- 4.207e-02 shuffle 2.245e+01 +/- 9.286e-01 rand_access 1.043e-02 +/- 1.008e-03 anom_mean 9.735e+01 +/- 7.157e-01
simple [0.60180306 0.5585711 0.53224325 0.543998 0.53996801 0.62273955 0.58446765 0.54749012 0.56783414 0.46035647] shuffle [21.01540852 22.26582432 21.06233811 22.01693344 23.76609921 22.58828068 21.89433455 23.24253702 23.66937137 22.94211268] rand_access [0.00799417 0.01057911 0.01166177 0.00974798 0.01139355 0.00966954 0.01068449 0.01076102 0.01063848 0.01112938] anom_mean [96.84190559 97.68350458 97.82067347 97.2511971 98.198493 96.65834308 98.76750207 96.52722168 97.1869967 96.56837201]
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210107-sched-graph.png">
Benchmark history
<img width="641" alt="Benchmark Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/dgx-20210107-benchmark-history.png">
Raw Data
<Client: 'tcp://127.0.0.1:44033' processes=10 threads=10, memory=540.94 GB> Distributed Version: 2020.12.0+17.g49e19c01 simple 5.559e-01 +/- 4.207e-02 shuffle 2.245e+01 +/- 9.286e-01 rand_access 1.043e-02 +/- 1.008e-03 anom_mean 9.735e+01 +/- 7.157e-01
Raw Values
simple [0.60180306 0.5585711 0.53224325 0.543998 0.53996801 0.62273955 0.58446765 0.54749012 0.56783414 0.46035647] shuffle [21.01540852 22.26582432 21.06233811 22.01693344 23.76609921 22.58828068 21.89433455 23.24253702 23.66937137 22.94211268] rand_access [0.00799417 0.01057911 0.01166177 0.00974798 0.01139355 0.00966954 0.01068449 0.01076102 0.01063848 0.01112938] anom_mean [96.84190559 97.68350458 97.82067347 97.2511971 98.198493 96.65834308 98.76750207 96.52722168 97.1869967 96.56837201]
Dask Profiles
Scheduler Execution Graph
<img width="641" alt="Sched Graph Image" src="https://raw.githubusercontent.com/quasiben/dask-scheduler-performance/benchmark-images/assets/20210107-sched-graph.png">