ViktorC
commented
5 years ago Hi Rob,
Could you try and run this using the master branch of PP4J? I have made quite a few changes, including some bug fixes, since version 2.2 and I am about to release a new version soon. I have compiled the jar for you and attached it to this message (I had to zip it to be able to do that).
The only thing you'd have to change to make it work with this version is the initialization of the pool. It would have to look something like this:
JavaProcessConfig jvmConfig = new SimpleJavaProcessConfig(JVMArch.BIT_64, JVMType.CLIENT, 128, 256, 256);
JavaProcessManagerFactory<?> jvmProcManagerFactory = new JavaProcessManagerFactory<>(jvmConfig, null, null, 5L*60L*1000L);
try {
jvmPool = new JavaProcessPoolExecutor(jvmProcManagerFactory, 4, 8, 1);
System.out.println("Started jvmPool");
} catch (InterruptedException e) {
logger.error(e,e);
}If you encounter the same problem using the new version as well, what would help me identify the cause is trace logs. PP4J uses SLF4J so if you have a compatible logging framework to bind to it, you can set the logging level to trace and you'll see a whole bunch of events logged from the pool.
I use Logback for the tests which makes logging configuration really simple. This is a good description of how to configure logging settings using SL4J and Logback: https://www.baeldung.com/logback.
rob42
Hi,
Ive built a MatlabExecutor class that starts a static pool as follows:
It will eventually be a servlet, so it has a doPost(request,response) method, but at present it just runs via a test that calls the MatlabExecutor wrapped in a runnable. eg
the important part of the doPost method is:
Calc.java is:
So now the problems. 1) If I run the above with "jvmPool.submit(new Calc(json), false);" the I get about 8 successful calcs, and then concurrent exceptions and stream corruptions. It seems like the submissions are not truly atomic and the JVM or streams are left in a bad state. Ideally I want to reuse JVMs for efficiency to avoid startup delays.
2) If I use "jvmPool.submit(new Calc(json),true);" then it works, but not all submissions are completed. I typically get 15 of 16 completed, but if i send 24 submissions i also get 15 completed. The rest dont show errors, but are never processed. Something in the submission queue maybe?
Its possible there is a better way to do this, I'm open to suggestions.