iris-hep / idap-200gbps

MIT License
3 stars 4 forks source link

feat: add Dask performance report and throughput calculation #3

Closed alexander-held closed 6 months ago

alexander-held commented 6 months ago

Adding a useful export of the Dask performance report as html, which includes convenient profiling information. Also adding a counter for the total data ingested. This needs testing by someone with permissions on the input files to ensure it works correctly.

cc @Andrew42