scikit-hep / hepconvert

BSD 3-Clause "New" or "Revised" License
8 stars 1 forks source link

Recursive `hadd` #66

Open clelange opened 4 months ago

clelange commented 4 months ago

A future feature that you pitched was to support hadd (as in $ROOTSYS/bin/hadd). One common issue is that if one wants to hadd a large number of files, e.g. from hundreds of batch jobs, this leads to very high memory usage. The workaround typically is to do this recursively, see e.g. https://gist.github.com/Nepomuk/588832a90824b634ad01 and https://gist.github.com/AndiH/121e3d89fc647fb65338

When implementing such a feature for hepconvert, it would be nice to preempt such limitations.