ufs-community / UFS_UTILS

Utilities for the NCEP models.
Other
21 stars 104 forks source link

Create new 'fixed' files with partial land and viirs vegetation data #483

Closed GeorgeGayno-NOAA closed 1 year ago

GeorgeGayno-NOAA commented 3 years ago

The use of grid cells with partial land and using new NESDIS viirs vegetation data is a candidate for inclusion into GFS v17. Create a complete set of 'oro' and surface climatological files for users to test with.

yangfanglin commented 3 years ago

please include Shan Sun - NOAA Federal shan.sun@noaa.gov

yangfanglin commented 3 years ago

Copied and pasted here discussions in emails: From Helin: Some of them are monthly climatology such as GVF and albedo and some of them are fixed like veg/soil types. Most of them are just parameters for the model and not a direct part of the initial condition in "sfc_data". But some of them are used to generate the ICs when there are some mismatches due to the new oro/land cover like rescaling soil moisture.


Here is Shan's document https://docs.google.com/document/d/126SKwxEQNwrtRejMAARKA0P2FOScYWV3LspsUtsxZOE/edit.
My understanding is that so far the fixed fields are make only for C384. We should expand this to include all supported resolutions (C48, C96, C192, C384, C768, C1152). Shan, do you have the new oro datasets (with 0.01% land_frac and 20% lake_frac thresholds) created for all resolutions ? Helin, please make the new fixed fields on the tiles for all resolution avaliable after Shan created the oro datasets. Please let Kate Friedman know the location of both the oro datasets and fixed fields on tiles so she can populate them to all computing platforms. Kate, please use a new "fix" directory to save these files for future UFS applications (starting from P7).


Bingfu: I have 2 sample cases ready here. /scratch2/NCEPDEV/stmp3/Bing.Fu/o/p7ic/com/gens/dev/merge I followed instruction from Shan and used the tiled fix files from Helin (/scratch1/NCEPDEV/global/Helin.Wei/save/para_gfs/sfc.C384_neworg).The chgres utility I used is chgres_cube suggested by George (/scratch1/NCEPDEV/da/George.Gayno/ufs_utils.git/UFS_UTILS).

GeorgeGayno-NOAA commented 3 years ago

Should these files use the VIIRS data? If so, I should make that data an official option. That will require a few scripting changes. Then you can create the 'oro' and surface files in one step.

yangfanglin commented 3 years ago

@GeorgeGayno-NOAA Yes, please ask Helin for a copy of the VIIRS data. Please also see Shan's document for the somewhat cumbersome steps she had to take to create oro datasets and ICs with fractional land/sea/ice/lake covers. Can this process be automated and built in the official UFS_Util tools ?

GeorgeGayno-NOAA commented 3 years ago

@GeorgeGayno-NOAA Yes, please ask Helin for a copy of the VIIRS data. Please also see Shan's document for the somewhat cumbersome steps she had to take to create oro datasets and ICs with fractional land/sea/ice/lake covers. Can this process be automated and built in the official UFS_Util tools ?

Creating 'oro' files with lakes and fractional land is already in 'develop'. Adding the option to use VIIRS is straightforward. Once that is done, it will be easy to create new grids with the options we want. According to @shansun6 's document, running the chgres step is the cumbersome part because chgres does not recognize partial land points.

GeorgeGayno-NOAA commented 3 years ago

@HelinWei-NOAA If you create a new set of files, I would document it under this issue?

Question to the group: Should the VIIRS data option be moved to 'develop'? Or are you still testing?

yangfanglin commented 3 years ago

I'd recommend to have the VIIRS data option moved to 'develop'

Fanglin

On Wed, May 12, 2021 at 4:01 PM GeorgeGayno-NOAA @.***> wrote:

@HelinWei-NOAA https://github.com/HelinWei-NOAA If you create a new set of files, I would document it under this issue?

Question to the group: Should the VIIRS data option be moved to 'develop'? Or are you still testing?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/UFS_UTILS/issues/483#issuecomment-840059362, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKY5N2NTPJUUBIXJ5PYVQDLTNLNCPANCNFSM434K325Q .

-- Fanglin Yang, Ph.D. Chief, Model Physics Group Modeling and Data Assimilation Branch

NOAA/NWS/NCEP Environmental Modeling Center

https://www.emc.ncep.noaa.gov/gmb/wx24fy/fyang/ https://www.emc.ncep.noaa.gov/gmb/wx24fy/fyang/

GeorgeGayno-NOAA commented 3 years ago

I'd recommend to have the VIIRS data option moved to 'develop' Fanglin

Will do.

GeorgeGayno-NOAA commented 3 years ago

@KateFriedman-NOAA I have new vegetation type data that will need to be added to ./fix/fix_sfc_climo.

KateFriedman-NOAA commented 3 years ago

@GeorgeGayno-NOAA Okie dokie, please point me to the data and I'll pull it into the fix set. Thanks!

GeorgeGayno-NOAA commented 3 years ago

@GeorgeGayno-NOAA Okie dokie, please point me to the data and I'll pull it into the fix set. Thanks!

On mars, please add the four files in this directory: /gpfs/dell2/emc/modeling/noscrub/George.Gayno/fv3.vegt.new.tundra.netcdf/fix_sfc_climo

KateFriedman-NOAA commented 3 years ago

Done and rsynced to FIX_DIRs on supported platforms:

[emc.glopara@m72a3 fix]$ pwd
/gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix
[emc.glopara@m72a3 fix]$ ll fix_sfc_climo/*viirs*
-r--r--r-- 1 emc.glopara emcmodel 72306138 Dec  3 14:56 fix_sfc_climo/vegetation_type.viirs.igbp.0.03.nc
-r--r--r-- 1 emc.glopara emcmodel 26110938 Dec  3 14:59 fix_sfc_climo/vegetation_type.viirs.igbp.0.05.nc
-r--r--r-- 1 emc.glopara emcmodel  6584538 Dec  3 15:02 fix_sfc_climo/vegetation_type.viirs.igbp.0.1.nc
-r--r--r-- 1 emc.glopara emcmodel 60396152 Dec  3 14:38 fix_sfc_climo/vegetation_type.viirs.igbp.conus.0.01.nc
GeorgeGayno-NOAA commented 3 years ago

Done and rsynced to FIX_DIRs on supported platforms:

[emc.glopara@m72a3 fix]$ pwd
/gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix
[emc.glopara@m72a3 fix]$ ll fix_sfc_climo/*viirs*
-r--r--r-- 1 emc.glopara emcmodel 72306138 Dec  3 14:56 fix_sfc_climo/vegetation_type.viirs.igbp.0.03.nc
-r--r--r-- 1 emc.glopara emcmodel 26110938 Dec  3 14:59 fix_sfc_climo/vegetation_type.viirs.igbp.0.05.nc
-r--r--r-- 1 emc.glopara emcmodel  6584538 Dec  3 15:02 fix_sfc_climo/vegetation_type.viirs.igbp.0.1.nc
-r--r--r-- 1 emc.glopara emcmodel 60396152 Dec  3 14:38 fix_sfc_climo/vegetation_type.viirs.igbp.conus.0.01.nc

Kate, can you also add to Orion?

KateFriedman-NOAA commented 3 years ago

Oops, my bad, Orion is updated now @GeorgeGayno-NOAA