Open joshschmelzle opened 2 years ago
More useful reference code here for working with multiprocessing.
https://docs.python.org/3/library/multiprocessing.html
https://www.blog.pythonlibrary.org/2016/08/02/python-201-a-multiprocessing-tutorial/
Use https://github.com/plasma-umass/scalene to help with profiling profiler
There is a scenario where a child process spawned by the main multiprocessing PID dies and profiler does not stop. Need to investigate ways to better handle signals and stop profiler if there is a problem in one of the other processes.