iris-hep / idap-200gbps-atlas

benchmarking throughput with PHYSLITE
6 stars 1 forks source link

Understand the number of dask tasks with `len(total_count.dask)`. #65

Closed gordonwatts closed 6 months ago

gordonwatts commented 6 months ago

I bet the issue is optimize vs non-optimize!

alexander-held commented 6 months ago

Looking at https://github.com/iris-hep/idap-200gbps-atlas/pull/62#issuecomment-2081705557 I feel like the optimization still is not quite working as expected. Comparing to https://github.com/iris-hep/idap-200gbps/pull/7, the graph after optimization here still has more nodes than strictly needed I think. I am not sure however why that is.