Testing first app-level build and UWtools workflow

[janahaddad]

@janahaddad I also update application level build to accommodate the change in the repo name. It is in the main branc at this point and tested on Hercules. Here are the commands that I am using,

• checkout app

git clone --recursive https://github.com/oceanmodeling/ufs-coastal-app.git

cd ufs-coastal-app

• build model

./build.sh --app=CSTLS --compiler=intel --build-dir=$PWD/build --install-dir=$PWD/install --platform=hercules

So, this compiles DATM+SCHSIM configuration on MSU's Hercules with intel compiler. All the executables are in $PWD/install/bin directory (i.e. model executable is named as ufs_model and tools related with SCHSIM are also in the same directory). Of course, I still need to work on app level build to fix the remaining issues but this is good starting point. I am not sure I could able to update the documentation to remove the all the references to ufs-coastal but I'll let you know if I could.

Originally posted by @uturuncoglu in #71

[janahaddad]

Testing this on Hercules & Hera:

I am trying 4 tests:

• [x] 1. CSTLS on Hercules exactly as above
• [x] 2. CSLTW on Hercules with an elif statement for CSLTW added to build.sh ~L192 for WW3 build
• [x] 3. CSTLS on Hera
• [x] 4. CSTLW on Hera

CSLTS on Hercules

• compiles with no errors
• there are a bunch of icc "remarks" that you've surely seen. I can copy here if useful, about ICC being deprecated and recommendation to move to ICX
• I think there might be a problem with the "move executables" part at https://github.com/oceanmodeling/ufs-coastal-app/blob/755ece38b82b388924255568eed732add458b699/build.sh#L260 There is no sorc/ufs-weather-model/ufs_model directory/file present, but it still somehow prints the "Moving executables to final locations ...\n" line.

CSTLW on Hercules

• I added the following to build.sh:

  # ww3 test
  elif [ "${APPLICATION}" == "CSTLW" ]; then
  CMAKE_SETTINGS="${CMAKE_SETTINGS} -DPDLIB=ON"
  fi

• ran ./build.sh --app=CSTLW --compiler=intel --build-dir=$PWD/build --install-dir=$PWD/install --platform=hercules
• compiled with no errors, also a bunch of "remarks", this time on specific ww3 src directory .F90 files
  • also a problem with the "move executables" part, but this time an error due to no /build/bin present

@uturuncoglu I'll keep working on this and add my findings here. Next step will be to test your UWtools installation and workflow steps from the slides.

[janahaddad]

Ok I see now, it's just moving everything to /install/bin/ including ufs_model.exe and schism tools. It's throwing error at L264 because there's no build/bin in this case.

Will test on Hera next and then try your UWtools workflow. Is there a reason not to add the CTSLW option at this point @uturuncoglu ?

[janahaddad]

CSTLS on Hera

• ./build.sh --app=CSTLS --compiler=intel --build-dir=$PWD/build --install-dir=$PWD/install --platform=hera
• compiled with no errors

CSTLW on Hera

• added the following to build.sh:

  # ww3 test
  elif [ "${APPLICATION}" == "CSTLW" ]; then
  CMAKE_SETTINGS="${CMAKE_SETTINGS} -DPDLIB=ON"

• ./build.sh --app=CSTLW --compiler=intel --build-dir=$PWD/build --install-dir=$PWD/install --platform=hera
• much slower but compiled with no errors.

[janahaddad]

Testing UW Tools installation steps on Hercules

• link to Ufuk slides with steps

  $ cd /work/noaa/nosofs/janahadd/ufs-coastal-app-20240920-cstls/sorc/uwtools

# create conda environment: 
  $ module load miniconda3/24.3.0
  $ conda create --prefix ../python/envs/uw-env
  $ conda activate ../python/envs/uw-env

• creates env in /work/noaa/nosofs/janahadd/ufs-coastal-app-20240920-cstls/sorc/python/envs/uw-env.

# install conda build and verify tools
  $ conda install -c conda-forge --override-channels conda-build conda-verify

# build and install uwtools
  $ conda build recipe -c conda-forge --override-channels
  $ conda install -c ../../python/envs/uw-env/conda-bld uwtools

• All steps until final step seem to be fine. At final step conda install -c ../../python/envs/mybase/conda-bld uwtools failed with error: UnavailableInvalidChannel: HTTP 404 UNAVAILABLE OR INVALID for channel conda-bld.

• Solved: path is just slightly wrong on the slide, should be ../python/envs/mybase/conda-bld uwtools

conda install -c ../python/envs/mybase/conda-bld uwtools

• works