search

moustakas / legacyhalos

Code and papers for a multi-faceted study of the baryonic content of dark matter halos in Legacy Survey imaging.
MIT License
4 stars 7 forks source link

distribute work based on number of CCDs #73

Closed moustakas closed 4 years ago

moustakas commented 5 years ago

When running legacyhalos-mpi, the unfinished coadds and custom-coadds are divided equally to all the available MPI ranks. The right thing to do is to use the number of CCDs as a metric for the "size" of each job and divide the work that way.

moustakas commented 4 years ago

In #116 we use the mosaic diameter (a proxy for the memory / compute needs) to distribute the sample to the MPI tasks. This code is in legacyhalos.LSLGA but will be inherited by the other projects.