search

kristinbranson / APT

Animal Part Tracker
GNU General Public License v3.0
71 stars 16 forks source link

JRC nslots specification is not saved with project #350

Closed allenleetc closed 3 years ago

allenleetc commented 3 years ago

This is currently a transient property on DeepTracker, update it to be saved.

Note, this prop probably still belongs on DeepTracker and not BackEnd as it could differ depending on the net etc.

arobie commented 3 years ago

Would be awesome if this gave me a usable error message! But what did you see in the log that tipped you off to a memory problem?

allenleetc commented 3 years ago

Two things in the log,

  1. As Mayank says, "Keyboard Interrupt" usually indicates a hard force-crash caused by something external to the process, eg the cluster scheduler.
  2. At the bottom, the "Total Requested Memory" is ~15GB which is the maximum/amount provided by a single compute slot. Actually this is a good point, I had misread this line for "Max Memory" so actually this is not really an indicator!!

That said did increasing the nslots fix the issue?

arobie commented 3 years ago

trying now

arobie commented 3 years ago

cmdline voodoo lObj.tracker.jrcnslots = 2; (just in case someone else runs into this)

allenleetc commented 3 years ago

This prop is now saved in the project. This prop/setting is per-tracker.