CIDARLAB / cello

Genetic circuit design automation
http://www.cellocad.org/
BSD 2-Clause "Simplified" License
801 stars 133 forks source link

Cello sometimes needs to be restarted #27

Open rkrishnasanka opened 6 years ago

rkrishnasanka commented 6 years ago

The case and the Full Demo examples are not working on the online instance. It seems like its timing out before it completes the entire computation.

screen shot 2017-08-11 at 2 12 48 pm
tim-tx commented 6 years ago

After a restart it's working, but this shouldn't be necessary.

rkrishnasanka commented 6 years ago

What was the issue ?

tim-tx commented 6 years ago

I have no idea why this happens, I think maybe others (Prashant or Shane) might have a few more details, but the stalling you noticed goes away when you just manually kill and restart the instance of Cello.

rkrishnasanka commented 6 years ago

Hmmm. That is weird, I'm trying to think of a reason why its stalling/timing out. Regardless one of the major problems with Cello right now is its execution engine. One can't submit multiple jobs, see the status of a running job, etc. It makes the API almost useless.

PrashantVaidyanathan commented 6 years ago

This is partly because of JVM issues due to which Cello essentially freezes and doesn't process any jobs. Unfortunately since the site is still up, the automated shell scripts do not pick this up and do not restart cello. This could also be due to a potential memory leak in Cello and/or other dependencies used by Cello.