a-paranjape / sahyadri-sandbox

Sandbox for testing codes and scripts related to Sahyadri simulations at IUCAA/TIFR/IISER-Pune/NCRA
0 stars 0 forks source link

Parallelize postprocessing #12

Open a-paranjape opened 3 months ago

a-paranjape commented 3 months ago

Postprocessing is currently done in a loop over all snapshots, but should be embarrassingly parallel since each snapshot+halo catalog is treated independently. Rewrite postprocess.py to use multiprocessing with up to 32 processors, paying attention to memory requirements.