jean-zay-users / jean-zay-doc

Collaborative documentation for and from Jean Zay users. Official Jean Zay documentation: http://www.idris.fr/eng/jean-zay/
https://jean-zay-doc.readthedocs.io/en/latest/
MIT License
108 stars 34 forks source link

A few things to add to the documentation after the November users committee #49

Open lesteve opened 3 years ago

lesteve commented 3 years ago

@remicres @mdiazmel feel free to edit and add more if I missed some:

RemiLacroix-IDRIS commented 3 years ago

compil machines. My understanding is that those are interactive machines where some of the limitations of the login node does not apply. They were created mostly to do multi-thread compilation because on the login nodes you are restricted to use only one CPU via cgroups.

That's correct, except that they are not really "interactive" (you cannot SSH on them directly). You need to request some resources via Slurm first. The easiest way is to use something like srun -c 5 -p compil --pty bash.

We have added some info on our documentation (for example in http://www.idris.fr/eng/jean-zay/cpu/jean-zay-cpu-exec_partition_slurm-eng.html) and it will be in the next Flash-Info.

lesteve commented 3 years ago

OK thanks for the details! It is really great that you don't need CPU hours to use them.

On top of this, these machines have access to the internet. This is great too because I have heard of workflows (e.g. PlantNet) where they need to refresh the dataset from their external databases and they need both CPUs and internet access.