coiled / benchmarks

BSD 3-Clause "New" or "Revised" License
28 stars 17 forks source link

Measure computation submission delay #1438

Closed fjetter closed 6 months ago

fjetter commented 6 months ago

On top of the plain optimization, this measures the time it takes to submit the graph. This is typically the time it takes after hitting compute until the dashboard shows something.

This is likely skewed by caching as introduced in https://github.com/dask-contrib/dask-expr/pull/917 (the fsspec implementation also uses various caching layers) but I still believe this is added value

phofl commented 6 months ago

thx