NCAR / ccpp-scm

CCPP Single Column Model
Other
14 stars 49 forks source link

update Hera setup scripts #299

Closed grantfirl closed 2 years ago

grantfirl commented 2 years ago

Fixes https://github.com/NCAR/ccpp-scm/issues/298

Hera sysadmins changed how python is managed on Hera: https://rdhpcs-common-docs.rdhpcs.noaa.gov/wiki/index.php/Anaconda#Migrating_from_the_old_.22RDHPCS_mirror.22_installation_to_the_Anaconda_installation

Specifically, installing shapely, configobj, and netCDF4 using the method of grabbing the modules from the RDHPCS mirror does not work any more. According to their documentation, the preferred method for managing python is for users to install their own version of Miniconda and use that, which is what I did on Hera.

Note that UFS is going to use the hpc-stack repo for managing dependencies on supported platforms, which should also affect these files. I tried to follow their instructions for using hpc-stack modules on Hera and ran into a runtime error when running the SCM executable (something about not being able to find the sz.o dynamic library, potentially related to szip, hdf5, and/or use of netCDF in the code).

siwei-noaa commented 2 years ago

May I know if only one step is required to use this new Hera setup script: source ../etc/Hera_setup_intel.csh? When I tried to use it, I got the message: Setting environment variables for CCPP-SCM on Hera with icc/ifort Loading intel and netcdf modules... Setting CC/CXX/FC environment variables Setting NCEPLIBS environment variables Loading cmake Loading the SCM python environment usage: conda [-h] [-V] command ...

conda is a tool for managing and deploying applications, environments and packages.

Options: positional arguments:

...

conda commands available from other packages: env Could not find conda environment: pyccpp You can list all discoverable environments with conda info --envs.

With this, I can compile the SCM successfully, but I could not run it. The error message is: Traceback (most recent call last): File "/scratch2/BMC/gsd-fv3-test/she/ccpp-scm/scm/bin/./run_scm.py", line 5, in import f90nml ModuleNotFoundError: No module named 'f90nml'

Thank you, Siwei

siwei-noaa commented 2 years ago

Please forget my previous message. I figured out the reason. I have installed my Anaconda, and it loads automatically when I log in Hera. In this way, I cannot load your SCM python environment from your Anaconda (source Hera_setup_intel.csh could not be finished correctly). After unloading my Anaconda environment, I can source Hera_setup_intel.csh without any issue.

Thank you, Siwei