search

transientskp / tkp

A transients-discovery pipeline for astronomical image-based surveys
http://docs.transientskp.org/
BSD 2-Clause "Simplified" License
19 stars 14 forks source link

Multiproc error: "Daemonic processes are not allowed to have children" #608

Closed AntoniaR closed 1 year ago

AntoniaR commented 1 year ago

I have been trying out the multiproc and serial versions of TraP. https://github.com/transientskp/tkp/blob/f176bbc567918f3ca32f0b694d98ed557849c802/tkp/config/project_template/pipeline.cfg#L28-L30

With serial, the data is processed correctly. With multiproc, I get the following error: 13:38:14 ERROR tkp.main: timestep raised <class 'AssertionError'> exception: daemonic processes are not allowed to have children

HannoSpreeuw commented 1 year ago

Thanks. What is the easiest way to reproduce this error?

I have method = "multiproc" and cores = 0 in tkp/config/project_template/pipeline.cfg and in my environment the error will not pop up from running all unit tests, i.e. from executing python runtests.py -v from the tests subdirectory.

HannoSpreeuw commented 1 year ago

@AntoniaR Please inform me about an easy way to reproduce this error.

AntoniaR commented 1 year ago

@HannoSpreeuw The best way to reproduce this error is to run TraP as normal (i.e. not the tests) on a small number of images with the parallel processing option on. I will send you some images for this shortly by email.

HannoSpreeuw commented 1 year ago

Thanks, I can reproduce it now.