ufs-community / UFS_UTILS

Utilities for the NCEP models.
Other
21 stars 107 forks source link

UFS-Utils Installation on NCAR HPC Derecho #964

Open muradme opened 3 months ago

muradme commented 3 months ago

Hi,

I am a new user of the Unified Forecast System (UFS), focusing on the Hurricane Analysis and Forecast System (HAFS). I am working on the NCAR HPC system, Derecho, where UFS installation is supported.

However, I have encountered difficulties installing UFS-Utils on Derecho, as it is not supported till now. Additionally, I could not find any links or resources for the necessary fix files to generate input files using UFS-Utils on this system.

Could you add support for UFS-Utils on NCAR HPC Derecho? Alternatively, if there is already a way to generate input files for UFS on Derecho, could you provide guidance or documentation on how to achieve this?

Thank you for your assistance.

Thanks, Murad.

GeorgeGayno-NOAA commented 3 months ago

I don't have access to Derecho, so unfortunately, I am unable to assist.

You want to generate input files to coldstart the UFS?

muradme commented 3 months ago

yes, thats correct. Especially, I want to create input files to coldstart UFS for HAFS configuration in derecho.

GeorgeGayno-NOAA commented 3 months ago

@BinLiu-NOAA - do you know of any HAFS developers who work on Derecho?

muradme commented 3 months ago

@GeorgeGayno-NOAA on a relevant issue, UFS weather model (https://github.com/ufs-community/ufs-weather-model?tab=readme-ov-file) is supported for derecho. I could install it in derecho, and run the regression tests for HAFS configuration. So, for that code, can I use UFS-utils to generate the input files? Do you support this for derecho? Or is there any other way to generate inputs for that code?

GeorgeGayno-NOAA commented 3 months ago

@GeorgeGayno-NOAA on a relevant issue, UFS weather model (https://github.com/ufs-community/ufs-weather-model?tab=readme-ov-file) is supported for derecho. I could install it in derecho, and run the regression tests for HAFS configuration. So, for that code, can I use UFS-utils to generate the input files? Do you support this for derecho? Or is there any other way to generate inputs for that code?

Do you have access to any of the NOAA RDHPCS machines (e.g., Hera)? Are you working with the HAFS group at NCEP/EMC?

muradme commented 3 months ago

No, I dont have access to any of the NOAA RDHPCS machines, and I am not working with the HAFS group at NCEP/EMC. I am a PhD student from University of Houston, and I am going to work on HAFS as a part of my PhD research.

GeorgeGayno-NOAA commented 3 months ago

No, I dont have access to any of the NOAA RDHPCS machines, and I am not working with the HAFS group at NCEP/EMC. I am a PhD student from University of Houston, and I am going to work on HAFS as a part of my PhD research.

Unfortunately, I don't have access to derecho. Maybe you can try the Q/A forum: https://github.com/orgs/ufs-community/discussions/categories/q-a

What exactly is the problem with the install on derecho?

muradme commented 3 months ago

The installation of UFS-utils stops as there is no links for fix files in derecho (I understand, as it is not supported in derecho). Can you provide me with the fix files, in github or ftp server or in any other way possible?

GeorgeGayno-NOAA commented 3 months ago

The installation of UFS-utils stops as there is no links for fix files in derecho (I understand, as it is not supported in derecho). Can you provide me with the fix files, in github or ftp server or in any other way possible?

Check here: https://noaa-ufs-srw-pds.s3.amazonaws.com/index.html#fix/

muradme commented 3 months ago

Thank you for sharing the fix files. While going through this, I have found that some fix files are not there (eg., fix_fv3_gmted2010, fix_vi, fix_hycom, fix_mom6, fix_ww3, fix_cdeps). I was going through the HAFS code and found the directory where all the fix files are stored. I would really appreciate if you could provide me with all this files. I am here attaching screenshot of fix file location. Again, thank you for your help on this matter.

Screenshot from 2024-06-28 08-34-42

GeorgeGayno-NOAA commented 3 months ago

Thank you for sharing the fix files. While going through this, I have found that some fix files are not there (eg., fix_fv3_gmted2010, fix_vi, fix_hycom, fix_mom6, fix_ww3, fix_cdeps). I was going through the HAFS code and found the directory where all the fix files are stored. I would really appreciate if you could provide me with all this files. I am here attaching screenshot of fix file location. Again, thank you for your help on this matter.

Screenshot from 2024-06-28 08-34-42

UFS_UTILS does not use most of those data directories. And I don't know where those data are.

I recommend you contact EPIC, who is charged with supporting community users: https://epic.noaa.gov/get-support/