search

leginon-org / leginon-redmine-archive

1 stars 0 forks source link

limit nproc passed from apGenericJob.py #1710

Open leginonbot opened 6 months ago

leginonbot commented 6 months ago

Author Name: Anchi Cheng (@anchi2c) Original Redmine Issue: 1710, https://emg.nysbc.org/redmine/issues/1710 Original Date: 2012-04-11 Original Assignee: Dmitry Lyumkis

The feature of passing nproc from job submission to AppionScript in r16471 causes the problem of nproc being set to nodes * ppn. This is not desirable in some scripts. Examples are reconUploader, and spider sessions that need large amount of memory. In the latter case it need to reserve all processors in a node but uses few of them in order to reserve all memory to its own use.

leginonbot commented 6 months ago

Original Redmine Comment Author Name: Anchi Cheng (@anchi2c) Original Date: 2012-04-11T16:43:14Z

r16475 puts in the mechanism in appionScript to do this. uploadExternalRefine.py uses this as an example. All AppionScripts that does not have non None maxnproc assigned will accept the nproc passed from job submission side once I revert from r16472 to r16471.

Dmitry, could you check and change other uploadRefinement type of script in appion/bin to impose a proper limit? Assign it to Scott for him to decide what maxnproc should be for the scripts that he ran into problem in bug #1482.

I will not revert to r16471 until I know you both are happy with the restrictions.

leginonbot commented 6 months ago

Original Redmine Comment Author Name: Amber Herold (Amber Herold) Original Date: 2012-06-04T16:01:38Z

Dmitry, What is the status on this?

leginonbot commented 6 months ago

Original Redmine Comment Author Name: Dmitry Lyumkis (@LyumkisLab) Original Date: 2012-06-04T20:54:43Z

Sorry, I have not had a chance to look at this. Any chance I can ask you or Amber to take care of it? If not, I can get to it after my group meeting.