In Python 3.7 and later, use os.register_at_fork to reset logging state post-fork()

itamarst / eliot

Eliot: the logging system that tells you *why* it happened

https://eliot.readthedocs.io

Apache License 2.0

1.1k stars 66 forks source link

In Python 3.7 and later, use os.register_at_fork to reset logging state post-fork() #441

Open itamarst opened 4 years ago

itamarst commented 4 years ago

multiprocessiing default mode on POSIX will result in Eliot logging configuration being inherited by children. This is not ideal, since it's inconsistent across multiprocessing modes.

os.register_at_fork would allow fixing this. However, this is not strictly backwards compatible...

Tushar-Sharma31 commented 3 years ago

how can we change default spawn to fork in windows...

itamarst commented 3 years ago

Windows does not support fork at all, it's a Unix-specific concept. I strongly recommend never using fork mode even when it is supported: https://pythonspeed.com/articles/python-multiprocessing/