USGS-CMG / data-life-cycle-cloud

Exploring the USGS Science Data Life Cycle in the Cloud: a 2017 CDI-funded project
1 stars 2 forks source link

Getting COAWST running on XSEDE Bridges #1

Open rsignell-usgs opened 6 years ago

rsignell-usgs commented 6 years ago

COAWST did not work out of the box on XSEDE Bridges. While the INLET test case worked just fine, the SANDY test case, which is coupled with WRF, did not successfully build.

rsignell-usgs commented 6 years ago

John Warner and I worked with the XSEDE Bridges support team to build the needed modules. The NetCDF module does not build HDF5 support by default, so that needed several iterations to get it right. But eventually it worked.

Here are John's instructions (with some minor additions):

1) 
ssh –l username login.xsede.org
pwd, Duo

2) 
gsissh bridges

2a) 
interact -t 02:00:00    # to get an interactive session for 2 hours.  This takes a long time to compile!

3) 
Edit Compilers/Linux-ifort.mk and change FFLAGS to be
FFLAGS := -f90=ifort –heap-arrays …..

4) 
Edit coawst .bash and set
USE_MPI=on
USE_MPIF90=on
which_MPI=openmpi
FORT=ifort

5) 
module load netcdf/4.4.4-fortran-icc
module load hdf5/1.8.16_intel
module list

Currently Loaded Modulefiles:
  1) psc_path/1.1               4) mpi/intel_mpi              7) hdf5/1.8.16_intel
  2) slurm/15.08.8              5) icc/16.0.3
  3) intel/compilers            6) netcdf/4.4.4-fortran-icc

6) 
export NETCDF_LIBDIR=$NETCDF_DIR/lib
export NETCDF_INCDIR=$NETCDF_DIR/include
export NETCDF=$NETCDF_DIR
export MCT_INCDIR=/opt/packages/mct/2.9.0/include
export MCT_LIBDIR=/opt/packages/mct/2.9.0/lib

7) 
./coawst.bash –j 2

choose [15] for compiler option
choose [1] for basic nest

That worked!