search

ExeClim / Isca

Idealized GCM from the University of Exeter
https://execlim.github.io/IscaWebsite
GNU General Public License v3.0
139 stars 125 forks source link

Running Isca on NCAR's Derecho machine? #272

Open parsellsx opened 3 weeks ago

parsellsx commented 3 weeks ago

Description

I'm trying to get Isca running on Derecho, the new NCAR machine. There is documentation here for how to get Isca running on the old NCAR Cheyenne machine, which has since been retired; unfortunately, the instructions don't work on Derecho. In particular, the ncar_pylib command seems to have been retired, and also the modules that are loaded in the cheyenne environment file (here) aren't recognized, so when I try to run py.test as the Isca documentation suggests, I get errors, shown below.

I'm wondering if anyone has successfully gotten Isca working on Derecho, and if so whether they could help me out. If it has been compiled successfully there, it would also probably be good to replace the old Cheyenne-specific instructions with a new Derecho version.

Screenshots

image The current cheyenne file in the Isca repo.

image Part of the output of running py.test.

Isca version

Commit ID: 8e451355468c1dbc900e95ef8e58e6fa5f000ff3. I'm using the main Execlim version.

System Information: To help us help you, provide the details about the machine where you are trying to install Isca.

To do this, please run the following code in Python:

import platform
print(platform.uname())

and paste the output below.

# Paste system info here
uname_result(system='Linux', node='crhtc44', release='5.14.21-150400.24.46-default', version='#1 SMP PREEMPT_DYNAMIC Thu Feb 9 08:38:18 UTC 2023 (2d95137)', machine='x86_64')
zpcllyj commented 2 weeks ago

Hi, I met this issue before. After hours of investigation, I realized that the default loaded environment was incompatible with Isca. Therefore, I add three additional lines to the src/extra/env/ubuntu_conda file (see below). By doing so I can successfully compile and run my Isca cases, but YMMV image

PS I am not familiar with GitHub, but if anyone finds this helpful please contribute it to the main branch

dphow commented 2 weeks ago

As some updates here, the intention I believe is to be able to run isca on Derecho but these tests screenshots were from crhtcXX nodes, ie Casper. Ideally, we can aim to provide a file for both Casper and Derecho but note that modules as were available on Cheyenne are now different and updated for both Casper and Derecho. We support Intel, NVHPC, Cray, and GCC compilers on AMD Milan for Derecho and Intel Skylake on Casper. Not sure which compiler suite(s) isca tends to have greatest performance with but can aim to spend some time soon to get a version working.

Ideally, we would not prefer to use a conda based install of say gfortran for building this and would rather use the system compilers and tools. Will update as progress is made but would appreciate other community contributions as appropriate.