search

conornally / starbug2

JWST PSF photometry for complex and crowded fields
GNU General Public License v3.0
4 stars 3 forks source link

Silent killing of child process when it runs out of memory #7

Open conornally opened 1 year ago

conornally commented 1 year ago

When multiprocessing over several files, if the system runs out of memory the subprocesses get killed but they don't report back to the parent, so it sits and waits for them to finish. Not sure what the fix is here though

conornally commented 1 year ago

To sort this i will need some kind of callback in the subprocess. This callback would need a timeout threshold, which might be tricky given that I don't know how long each psf step will take