search

DUNE-DAQ / fdreadoutlibs

fdreadoutlibs
0 stars 3 forks source link

Investigate prescaling SW TP generation #73

Closed eflumerf closed 1 year ago

eflumerf commented 1 year ago

We have a problem where the nodes cannot keep up with TP generation in SWTP mode. We can either run with fewer links, as we have been doing, or we could try skipping time windows in order to keep up. There may be issues with other parts of the system which are expecting contiguous timestamps, however.

eflumerf commented 1 year ago

np04-srv-028 and np04-srv-029 can only handle 7 links each, for example. If we wanted to run with the full 40 links, we would need to prescale by at least a factor of 6.

roland-sipos commented 1 year ago

Skipping time-windows is not really an option for the parallel-post processing, as it would go against the main design principles. One could add a feature to skip frames, but then it would impact the algorithm. I think the only solution here is indeed to run fewer links by disabling the postprocessing step for selected links.

Also, we know already based on our readout perf-evaluations that on the Cascade Lake hosts we won't manage to run 2 APAs with software TPG due to core count limitations.

eflumerf commented 1 year ago

OK, thanks @roland-sipos