MLResearchAtOSRAM / cause2e

The cause2e package provides tools for performing an end-to-end causal analysis of your data. Developed by Daniel Grünbaum (@dg46).
https://gitlab.com/causal-inference/working-group/-/wikis/home
MIT License
56 stars 4 forks source link

Allow Java VM restart #32

Open dg46 opened 2 years ago

dg46 commented 2 years ago

Currently, the Java VM cannot be restarted after it is shut down. This limitation can be avoided if we run all tasks that require the VM in a separate process using the multiprocessing module: https://github.com/LeeKamentsky/python-javabridge/issues/88 This would also allow us to run many causal discovery procedures in parallel. A downside is that the start of a new process adds additional overhead that will affect the runtime of an analysis.

dg46 commented 2 years ago

The issue is fixed for Windows on a separate branch (fix-java-vm). Unfortunately, the differences in multiprocessing between Linux and Windows lead to failing tests in the CI pipeline for the Linux builds. I cannot properly debug this at the moment, so for now the proposed solution is to clone the version from the fix-java-vm branch in case you need to restart the Java VM in any downstream tasks.