feat: track worker count, save measurement information, optimize branches

iris-hep / idap-200gbps-atlas

benchmarking throughput with PHYSLITE

6 stars 1 forks source link

Closed alexander-held closed 3 months ago

alexander-held commented 3 months ago

This does a lot at once:

new infrastructure to track relevant measurement information in dedicated folder to allow reloading it later for plots
track worker count in background for additional metrics
optimized branch list for better throughput
minor changes to coffea setup, allows saving pre-processing output

resolves #40