ufs-community / ufs-weather-model

UFS Weather Model
Other
132 stars 239 forks source link

ufs-weather-model on C6 #2313

Open BijuThomas-NOAA opened 3 weeks ago

BijuThomas-NOAA commented 3 weeks ago

The spack-stack is available on the Gaea C6 and wondering if the ufs-weather-model is tested or if there is a plan to test it on the Gaea C6 platform. /autofs/ncrc-svm1_proj/epic/spack-stack/spack-stack-1.6.0/envs/unified-env-c6/install/modulefiles/Core

junwang-noaa commented 3 weeks ago

@jkbk2004 Does anyone from EPIC side have access to C6?

jkbk2004 commented 3 weeks ago

@jkbk2004 Does anyone from EPIC side have access to C6?

@junwang-noaa recommendation was submitted to allow permission for library team first. @RatkoVasic-NOAA @natalie-perlin Do we have C6 permission ?

RatkoVasic-NOAA commented 3 weeks ago

@junwang-noaa @jkbk2004 I just tested, I logged in Gaea C6.

junwang-noaa commented 3 weeks ago

@RatkoVasic-NOAA may I ask if the library is ready for the UFS-weather-model testing on C6? Thanks

RatkoVasic-NOAA commented 3 weeks ago

@RatkoVasic-NOAA may I ask if the library is ready for the UFS-weather-model testing on C6? Thanks

@junwang-noaa I'm just exploring where we can write on /f6 file system. I created /gpfs/f6/scratch/Ratko.Vasic directory. I'll go ahead and try to compile ufs-weather-model using autofs/ncrc-svm1_proj/epic/spack-stack/spack-stack-1.6.0/envs/unified-env-c6 spack stack.

RatkoVasic-NOAA commented 3 weeks ago

@junwang-noaa I tested ufs-wm Only change I did was in /gpfs/f6/scratch/Ratko.Vasic/ufs-weather-model/modulefiles/ufs_gaea.intel.lua (there was missing esmf@8.6.0 modulefile in spack-stack, I added it manually, it is OK now) I compiled using cmake and it finished ok: /gpfs/f6/scratch/Ratko.Vasic/ufs-weather-model/build/ufs_model

Now, who ever wants to use rt.sh, they have to change detect_machine.sh and GAEA part in rt.sh

junwang-noaa commented 3 weeks ago

@RatkoVasic-NOAA thank for testing ufs-wm! @jkbk2004 will your team run RT on C6? Thanks.

jkbk2004 commented 3 weeks ago

@RatkoVasic-NOAA thank for testing ufs-wm! @jkbk2004 will your team run RT on C6? Thanks.

@junwang-noaa Sure! let me check.

jkbk2004 commented 3 weeks ago

It looks like /gpfs/f6 is available to only for those who have permission. I am not able to access yet. @BrianCurtis-NOAA FYI

AlexanderRichert-NOAA commented 6 days ago

Please try /ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/unified-env/install/modulefiles/Core Assuming everything works then this will be the permanent installation path.

junwang-noaa commented 6 days ago

@RatkoVasic-NOAA would you please update your branch with the spack-stack Alex built? We can then run RT test to see if there is any issues. @jkbk2004 do your team have access to C6? Thanks

jkbk2004 commented 6 days ago
Jong.Kim@gaea53:/ncrc/proj/epic$ cd /gpfs/f6/scratch/
-bash: cd: /gpfs/f6/scratch/: No such file or directory

@junwang-noaa C6 is still in early access only for lib team on EPIC side.

junwang-noaa commented 3 days ago

@jkbk2004 can you confirm that you can't login to C6 (e.g. node gaea63)?

jkbk2004 commented 3 days ago

@jkbk2004 can you confirm that you can't login to C6 (e.g. node gaea63)?

@junwang-noaa Oh! C6 node

Jong.Kim@gaea63:/gpfs/f6/scratch/Jong.Kim

Let me try to run on that.

jkbk2004 commented 3 days ago

@zach1221 @FernandoAndrade-NOAA FYI: good to try test run on C6.