Parallel processing - Githubissues

umami-hep / umami-preprocessing

UPP: Umami PreProcessing

0 stars 31 forks source link

Parallel processing #6

Open samvanstroud opened 1 year ago

samvanstroud commented 1 year ago

some options

process different samples in parallel in different threads on the same machine
batch processing
grid processing

zcapjdb commented 5 months ago

Related to this issue, but I think even the option to run stuff like the resampling on a per component basis would be very useful as they are independent at that stage

samvanstroud commented 5 months ago

Components can be sampled in parallel already if they are in the same sample. So really we just need to parallelise the samples. I'm all for it though