BiBiServ / bibigrid

BiBiGrid is a tool for an easy cluster setup inside a cloud environment.
Apache License 2.0
11 stars 8 forks source link

Support an up-to-date version of SLURM #327

Closed jkrue closed 2 years ago

jkrue commented 2 years ago

SLURM is part of the chosen operating system, but the installed version of SLURM depends on the installed os version.

OS Version SLURM version
Ubuntu 18.04 LTS 17.11.2-1
Ubuntu 20.04 LTS 19.05.5-1
Debian 10 (Buster) 18.08.5.2-1
Debian 11 (BullsEye 20.11.4-2

It would be nice to have a) the same SLURM version on all supported OS versions b) a version that supports SLURM REST API (need at least version 20.02)

Since there are no possible new packages available (as far as I know) there are two possibilities.

  1. Build (and install) our own packages
  2. Use snap packages, the latest available version is 20.02.1.
jkrue commented 2 years ago

Building deb packages in an Ubuntu 18.04/20.04 or Debian 10/11 container works out of the box.

$ apt update
$ apt install -y devscripts
$ apt install -y libhttp-parser-dev libyaml-dev libjson-c-dev libjwt-dev
$ apt install -y libmunge-dev libncurses5-dev po-debconf libgtk2.0-dev default-libmysqlclient-dev libpam0g-dev libperl-dev chrpath liblua5.1-0-dev libhwloc-dev dh-exec librrd-dev libipmimonitoring-dev hdf5-helpers libfreeipmi-dev libhdf5-dev man2html libcurl4-openssl-dev libpmix-dev liblz4-dev
$ git clone https://salsa.debian.org/hpc-team/slurm-wlm.git
$ cd slurm-wlm
$ nice -19 debuild -us -uc -b -j$(nproc)

The version supported by https://salsa.debian.org/hpc-team/slurm-wlm.git is 20.11.8, which is not the latest version but newer than anything supprted by default (see table above). The de.NBI cloud site Bielefeld host de.NBI (aka BiBiGrid) related self-build debian packages in an apt repository (https://apt.bi.denbi.de).

jkrue commented 2 years ago

One reason to have an up-to-date version of SLURM is to make the REST API available for projects. The slurm task should be enhanced to configure :

  1. slurmdbd (Accouting)
  2. slurmrestd