search

Leeds-MONC / monc

MONC (Leeds fork)
BSD 3-Clause "New" or "Revised" License
5 stars 18 forks source link

Compiling MONC on ARCHER2 #33

Open sjboeing opened 3 years ago

sjboeing commented 3 years ago

Opening this as a new issue. I think it would be good to work on an fcm-setup, as the makefile setup is broken due to interdependencies between modules.

sjboeing commented 3 years ago

Note that there may be an issue with using more recent versions of GCC. This has been resolved in a recent pull request (#28)

leifdenby commented 3 years ago

Just linking this up that I've got an ongoing pull-request on https://github.com/Leeds-MONC/monc/pull/32 to try and get MONC running on ARCHER2

leifdenby commented 3 years ago

notes for @ralphburton on compiling on ARCHER2 in the following comment: https://github.com/Leeds-MONC/monc/issues/20#issuecomment-735776925

MarkUoLeeds commented 3 years ago

Hi @sjboeing @leifdenby I did some work trying to get RCE case running without casimand used the fcm-make/monc-cray-cray-safe.cfg build I was using MOSRS r8166 and will now look at the Leeds-MONC version as I got stuck with that one. (timed out on a short job). We ought to use the same at version at Leeds. is the head here okay?

This is my job submission script anyway although I copied from Reading and there aresome thing I do not like (merged log files): 

#!/bin/bash
#SBATCH --job-name=no_casim3
#SBATCH --output=%x.o%j
 # %x gives job-name
 # %j gives jobid (individual SLURM_JOB_ID)
 # %A gives jobid (master   SLURM_ARRAY_JOB_ID)
 # %a gives array task id number
 # https://slurm.schedmd.com/sbatch.html
#SBATCH --open-mode=append
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=128
#SBATCH --ntasks=128
#SBATCH --cpus-per-task=1
#SBATCH --time=00:20:00
#SBATCH --account=n02
#SBATCH --partition=standard
#SBATCH --reservation=shortqos
#SBATCH --qos=short
module load epcc-job-env
####
#   OTHER MODULES HERE
module load epcc-job-env
module load cce/10.0.4
module load cray-netcdf-hdf5parallel/4.7.4.2
module load cray-hdf5-parallel/1.12.0.2
module load petsc/3.13.3
module list
#
####
# Allow multi-threading on cray (this is from old archer..)
export MPICH_MAX_THREAD_SAFETY=single
# Write to combined o/e file (see 'append' above)
pwd
date
# Set the number of threads to 1
#  This prevents any system libraries from automatically
#  using threading.
export OMP_NUM_THREADS=1
ulimit -c unlimited
# set env variables for submission command
config_path=RCE_nocasim_short3.mcf
RUN_NAME=RCE3_dump_
# srun to launch the executable
mkdir -p ./monc_stdout
date > monc_stdout/output_${RUN_NAME}1 2>&1
echo $config_path >> monc_stdout/output_${RUN_NAME}1 2>&1
srun --unbuffered --cpu-bind=cores --distribution=block:block --hint=nomultithread ./monc_driver.exe --config=$config_path >> monc_stdout/outp
ut_${RUN_NAME}1 2>&1

## END OF DOC