search

erik78se / Jobbers

Jobbers is a Python package that produces so called application "job-scripts". Those scripts are then ready to be submitted into SLURM.
GNU General Public License v3.0
1 stars 1 forks source link

Ask for memory requirement on the master node #24

Open hallback opened 5 years ago

hallback commented 5 years ago

Define available memory sizes in default_config.yaml (384G, 768G, 1536G), and ask user during jobbers execution which size is required for the current job. The question should also be asked for eigenfrequency jobs (i.e. all jobs).

NOTE: subtract a gig or two in the job size!

Default should be 768G. Mention total amount of nodes in the GUI. Listing of available nodes per memory size is nice but also overkill.

erik78se commented 5 years ago

Default needs to be within reason (lets say 1BG) or the default will fail automated test suits etc further down the road as a lxd container for testa likely will nog have 700+ ram

Den ons 22 maj 2019 12:57Johan Hallbäck notifications@github.com skrev:

Define available memory sizes in default_config.yaml (384G, 768G, 1536G), and ask user during jobbers execution which size is required for the current job. The question should also be asked for eigenfrequency jobs (i.e. all jobs).

NOTE: subtract a gig or two in the job size!

Default should be 768G. Mention total amount of nodes in the GUI. Listing of available nodes per memory size is nice but also overkill.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/erik78se/Jobbers/issues/24?email_source=notifications&email_token=AAGPVK4MHLTXLB4F3DMATGDPWURIRA5CNFSM4HOTC4NKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4GVFXJHQ, or mute the thread https://github.com/notifications/unsubscribe-auth/AAGPVKZ54CVOUS3NKH5IQ2LPWURIRANCNFSM4HOTC4NA .

niklasmelin commented 5 years ago

The 768Gb is reasonable from a production point of view and will comprise 99% of all usage. To set a default behavior of 1Gb which will force 100% of the users to take manual action when submitting a job. If the the users fails to to so, all jobs will fail which will have a direct impact on lead time.

erik78se commented 5 years ago

Don't worry about that part Niklas. We must still configure site-wide configs in the default config yaml-file (packet level) when we deploy the software on the login-nodes in slurm. This will allow for Jobbers to be configured site-wide, packet-wide and users wide. Picking a conservative setting for the codebase is normally a smart move. The deployment tools (juju/charms/ansible etc) will take care of setting those site and packet wide explicit values.

On Thu, May 23, 2019 at 7:37 AM niklasmelin notifications@github.com wrote:

The 768Gb is reasonable from a production point of view and will comprise 99% of all usage. To set a default behavior of 1Gb which will force 100% of the users to take manual action when submitting a job. If the the users fails to to so, all jobs will fail which will have a direct impact on lead time.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/erik78se/Jobbers/issues/24?email_source=notifications&email_token=AAGPVK36M4Z52H5ZQ2VDU5LPWYUR5A5CNFSM4HOTC4NKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODWBDZ2Q#issuecomment-495074538, or mute the thread https://github.com/notifications/unsubscribe-auth/AAGPVKYDVGS4VBEGHHYJUT3PWYUR5ANCNFSM4HOTC4NA .