NOAA-EMC / hpc-stack

Create a software stack for HPC's
GNU Lesser General Public License v2.1
30 stars 36 forks source link

Is there a UFS_UTILS update for hpc-stack-1.1.0? Should there be? #89

Closed edwardhartnett closed 3 years ago

edwardhartnett commented 3 years ago

We are doing the hpc-stack-1.1.0 release in the near future. @GeorgeVandenberghe-NOAA has tagged a release in UFS_UTILS. Shouldn't we be using it?

GeorgeVandenberghe-NOAA commented 3 years ago

ufs-utils is not a part of NCEPLIBS unless someone has again increased our scope. It's maintained by the global branch. It's a big bunch of utilities that do various things. Because of all of the different build scripts for the utilities it's tedious but not real difficult to port to new platforms. In my last port in 2019, I ripped up the build system and replaced system specific modules with a generic set and got rid of system detection logic in most of the build. It's a forklift upgrade to that build system though and I never committed it. In a 2020 WCOSS2 port I dispensed with generic modules and created one universal set for all of the utilities and changed several dozen build scripts to use the universal set thus getting rid of several dozen generic modules selected from a few hundred system specific modules . Again though it's a radical change to the build and I have not committed it.

People still seem to prefer utility and system specific modues so I'm not pushing my changes back but when I need to port to something like an AWS cloud, I go with my way.

On Thu, Nov 19, 2020 at 1:59 PM Edward Hartnett notifications@github.com wrote:

We are doing the hpc-stack-1.1.0 release in the near future. @GeorgeVandenberghe-NOAA https://github.com/GeorgeVandenberghe-NOAA has tagged a release in UFS_UTILS. Shouldn't we be using it?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/89, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANDS4FXPVR66HLTHYKRDIGTSQVTHDANCNFSM4T3ZOAGA .

--

George W Vandenberghe

IMSG at NOAA/NWS/NCEP/EMC

5830 University Research Ct., Rm. 2141

College Park, MD 20740

George.Vandenberghe@noaa.gov

301-683-3769(work) 3017751547(cell)

edwardhartnett commented 3 years ago

Is UFS_UTILS in hpc-stack?

kgerheiser commented 3 years ago

No, it's treated like the weather model. You use hpc-stack to build UFS_UTILS, but it's not included.

edwardhartnett commented 3 years ago

OK, well then, never mind. ;-)

GeorgeVandenberghe-NOAA commented 3 years ago

If we were to accept UFS-Utils as we did wgrib2 and prod utils, a d grib utils we would have to come up with a comprehensive test plan and extensive documentation plan for what is basically a large code drop into our bucket. Testing and documentation deficiencies are general in the noaa code base and NCEPLIBS is just one needle in a haystack full of them.

I think UFS utils is out of scope for us but the prod utils and grib utils ingest was definitely a good idea for centralization reasons .

I will remain working on my phone till monday at least. The NCEP building has a positive COVID case and is shut down UFN

On Thursday, November 19, 2020, Edward Hartnett notifications@github.com wrote:

OK, well then, never mind. ;-)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/89#issuecomment-730615186, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANDS4FQCSCYBACLCXTQ6IETSQV47HANCNFSM4T3ZOAGA .

--

George W Vandenberghe

IMSG at NOAA/NWS/NCEP/EMC

5830 University Research Ct., Rm. 2141

College Park, MD 20740

George.Vandenberghe@noaa.gov

301-683-3769(work) 3017751547(cell)