search

iris-hep / idap-200gbps-atlas

benchmarking throughput with PHYSLITE
6 stars 1 forks source link

Add the module generating the message into the log messages we generate #78

Closed gordonwatts closed 4 months ago

gordonwatts commented 4 months ago

Currently our log messages are not helpful as to where the messages are coming from:

0000.0323 - INFO - Using release 22.2.107 for type information.
0000.0538 - WARNING - Unknown type for name len
0000.4665 - INFO - Building ServiceX query
0000.4666 - INFO - Using dataset mc20_13TeV.364157.Sherpa_221_NNPDF30NNLO_Wmunu_MAXHTPTV0_70_CFilterBVeto.deriv.DAOD_PHYSLITE.e5340_s3681_r13145_p6026.
0000.4667 - INFO - Running on the full dataset.
0000.4672 - INFO - Starting ServiceX query

Add the source of the log message into our formatter.

gordonwatts commented 4 months ago

Now;

0046.5172 - INFO - servicex_materialize_branches - Field run_number is not a scalar field. Skipping count.
0046.6635 - INFO - servicex_materialize_branches - Number of tasks in the dask graph: optimized: 39 unoptimized 451
0046.6635 - INFO - servicex_materialize_branches - Computing the total count
0047.1996 - INFO - servicex_materialize_branches - Done: result = 2,325