Platform: make all analysis runs execute in a subprocess for easy termination.

dpinney / omf

The Open Modeling Framework for smart grid cost-benefit analysis.

https://omf.coop

GNU General Public License v2.0

112 stars 60 forks source link

Platform: make all analysis runs execute in a subprocess for easy termination. #79

Closed dpinney closed 11 years ago

dpinney commented 11 years ago

There are some big problems with using the multiprocessing library and flask together. Each multiprocessing.Process thread that we spawn creates another copy of the web servers.

The likely workaround is to put the analysis running code in a completely different server running on the same machine.

cshjin commented 11 years ago

How about MultiThread?

dpinney commented 11 years ago

I looked into multithreading, and terminating threads is problematic. Forcing thread termination can lead to memory leaks.

dpinney commented 11 years ago

Closing, because I'm convinced that Celery is the way forward.