Test NOAA Unstructured grids in MET-12.0.0

AliciaBentley-NOAA commented 3 months ago

Describe the Task

Samira Ardani (EMC) is tasked with adding verification for GLWU in EVS v2.0. GLWU has unstructured surface grids. See the discussion of NOAA's unstructured grids in the METplus Users Telecon notes from 2/5/24.

NOMADS GLWU data (netCDF = unstructured grids): https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/ For example, this NetCDF file

EMC requests that DTC check that these unstructured files can be read by MET-12.0.0 (similar to MPAS).

Time Estimate

Estimate the amount of work required here. Issues should represent approximately 1 to 3 days of work.

Sub-Issues

Consider breaking the task down into sub-issues.

[ ] Add a checkbox for each sub-issue here.

Relevant Deadlines

To be included in MET-12.0.0 release.

Funding Source

Define the source of funding and account keys here or state NONE.

Define the Metadata

Assignee

[ ] Select engineer(s) or no engineer required
[ ] Select scientist(s) or no scientist required

Labels

[ ] Review default alert labels
[ ] Select component(s)
[ ] Select priority
[ ] Select requestor(s)

Milestone and Projects

[ ] Select Milestone as the next official version or Backlog of Development Ideas
[ ] For the next official version, select the MET-X.Y.Z Development project

Define Related Issue(s)

Consider the impact to the other METplus components.

[ ] METplus, MET, METdataio, METviewer, METexpress, METcalcpy, METplotpy

Task Checklist

See the METplus Workflow for details.

[ ] Complete the issue definition above, including the Time Estimate and Funding Source.
[ ] Fork this repository or create a branch of develop. Branch name: feature_<Issue Number>_<Description>
[ ] Complete the development and test your changes.
[ ] Add/update log messages for easier debugging.
[ ] Add/update unit tests.
[ ] Add/update documentation.
[ ] Push local changes to GitHub.
[ ] Submit a pull request to merge into develop. Pull request: feature <Issue Number> <Description>
[ ] Define the pull request metadata, as permissions allow. Select: Reviewer(s) and Development issue Select: Milestone as the next official version Select: MET-X.Y.Z Development project for development toward the next official release
[ ] Iterate until the reviewer(s) accept and merge your changes.
[ ] Delete your fork or branch.
[ ] Close this issue.

DanielAdriaansen commented 2 months ago

@AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing: https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

AliciaBentley-NOAA commented 2 months ago

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

AliciaBentley-NOAA commented 2 months ago

Hi Alicia, There is no unstructured NWPS file in Nomads. Only GLWU has those types of files. Thanks!

Best, Samira

On Thu, Apr 18, 2024 at 3:55 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

AliciaBentley-NOAA commented 2 months ago

Hi Samira,

To confirm, NWPS does not have unstructured grids that we need to share with DTC to test in MET-12.0.0? NWPS is no longer a concern for unstructured grid capabilities?

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 5:42 PM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, There is no unstructured NWPS file in Nomads. Only GLWU has those types of files. Thanks!

Best, Samira

On Thu, Apr 18, 2024 at 3:55 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

AliciaBentley-NOAA commented 2 months ago

Hi Alicia, I had a great chat discussion about your question with Ali Salimi from NWPS modeling (CC'd here), and here is what I found: The data is first obtained on the native unstructured grids (high resolution) then modelers interpolate it on the structured grid and post it as grib2 format. So, the final product is in .grib2 format and I can confirm that NWPS is not a concern for unstructured grid capabilities. Thank you!

Best, Samira

On Thu, Apr 18, 2024 at 4:52 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

To confirm, NWPS does not have unstructured grids that we need to share with DTC to test in MET-12.0.0? NWPS is no longer a concern for unstructured grid capabilities?

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 5:42 PM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, There is no unstructured NWPS file in Nomads. Only GLWU has those types of files. Thanks!

Best, Samira

On Thu, Apr 18, 2024 at 3:55 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

AliciaBentley-NOAA commented 2 months ago

Thanks, Samira! I've updated this MET issue to only include the testing of unstructured GLWU files.

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Fri, Apr 19, 2024 at 10:23 AM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, I had a great chat discussion about your question with Ali Salimi from NWPS modeling (CC'd here), and here is what I found: The data is first obtained on the native unstructured grids (high resolution) then modelers interpolate it on the structured grid and post it as grib2 format. So, the final product is in .grib2 format and I can confirm that NWPS is not a concern for unstructured grid capabilities. Thank you!

Best, Samira

On Thu, Apr 18, 2024 at 4:52 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

To confirm, NWPS does not have unstructured grids that we need to share with DTC to test in MET-12.0.0? NWPS is no longer a concern for unstructured grid capabilities?

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 5:42 PM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, There is no unstructured NWPS file in Nomads. Only GLWU has those types of files. Thanks!

Best, Samira

On Thu, Apr 18, 2024 at 3:55 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen < @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

AliciaBentley-NOAA commented 2 months ago

Sounds good, Alicia. Thanks!

Best, Samira

On Fri, Apr 19, 2024 at 9:25 AM Alicia Bentley - NOAA Federal < @.***> wrote:

Thanks, Samira! I've updated this MET issue to only include the testing of unstructured GLWU files.

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Fri, Apr 19, 2024 at 10:23 AM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, I had a great chat discussion about your question with Ali Salimi from NWPS modeling (CC'd here), and here is what I found: The data is first obtained on the native unstructured grids (high resolution) then modelers interpolate it on the structured grid and post it as grib2 format. So, the final product is in .grib2 format and I can confirm that NWPS is not a concern for unstructured grid capabilities. Thank you!

Best, Samira

On Thu, Apr 18, 2024 at 4:52 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

To confirm, NWPS does not have unstructured grids that we need to share with DTC to test in MET-12.0.0? NWPS is no longer a concern for unstructured grid capabilities?

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 5:42 PM Samira Ardani - NOAA Affiliate < @.***> wrote:

Hi Alicia, There is no unstructured NWPS file in Nomads. Only GLWU has those types of files. Thanks!

Best, Samira

On Thu, Apr 18, 2024 at 3:55 PM Alicia Bentley - NOAA Federal < @.***> wrote:

Hi Samira,

Can you please provide DTC with a specific, unstructured NWPS file from https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/ for them to test with? Thank you!

Take care, Alicia

Alicia M. Bentley, Ph.D. Global Verification Project Lead Model Evaluation Group (MEG) https://www.emc.ncep.noaa.gov/users/meg/home/ NOAA/NWS/NCEP/EMC (VPPPG Branch) Work Phone: ‪(301) 683-3783‬

On Thu, Apr 18, 2024 at 4:52 PM Dan Adriaansen < @.***> wrote:

@AliciaBentley-NOAA https://github.com/AliciaBentley-NOAA can you provide a specific file at this URL to try (NWPS): https://nomads.ncep.noaa.gov/pub/data/nccf/com/nwps/prod/

I downloaded this file for GLWU for testing:

https://nomads.ncep.noaa.gov/pub/data/nccf/com/glwu/prod/glwu.20240418/glwu.glwu_lc.t12z.nc

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/MET/issues/2860#issuecomment-2065303493, or unsubscribe https://github.com/notifications/unsubscribe-auth/APUWOBGRYRU77V6SFWOURPDY6AW65AVCNFSM6AAAAABGH3UE56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGMYDGNBZGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

-- Samira Ardani, PhD Physical Scientist III Lynker at NOAA/NWS/NCEP/EMC

DanielAdriaansen commented 2 months ago

I was able to read the GLWU data with GridStat successfully- just a basic test using the same field for FCST/OBS. If you'd like me to also test PointStat that's no problem but I will need some point observations to use for that test. Let me know. glwu_gridstat

AliciaBentley-NOAA commented 2 months ago

@DanielAdriaansen Thank you very much! This is excellent news.

I'm working with the verification developers to try to find some older Great Lakes buoy files in order to test PointStat with. Buoys are not in the Great Lakes all year (they freeze over) and we're not sure that they've been deployed yet for this year. I'll let you know if we can find some old buoy files! We'd really like the test PointStat too!

SamiraArdani-NOAA commented 2 months ago

Hi @DanielAdriaansen. Thankyou for this great news! For testing GLWU PointStat, you can use the data from NDBC website: If you visit http://www.ndbc.noaa.gov, and zoom in to the map for Great Lakes zone, you will see several buoys reporting there. Please click on one of those buoys choose "view details" and see if that buoy reports the wave data you are looking for. For example, if you want to test for "significant wave height", see if the buoy reports WVHT (WVHT is equivalent to significant wave height in that table). Then download the buoyID.txt from https://www.ndbc.noaa.gov/data/realtime2/. I found one buoy in the Great Lakes zone that reports sig. wave height. I have attached the .txt. file. 45214.txt

DanielAdriaansen commented 2 months ago

Thank you @SamiraArdani-NOAA!

Compared to GLWU, is WVHT the same as wch (significant breaking wave height) or hs (significant height of wind and swell height), or something else?

SamiraArdani-NOAA commented 2 months ago

Hi @DanielAdriaansen. significant wave height (WVHT) in NDBC data table is compared with Hs and is defined as significant wave height of combined wind wave and swell. Also, If you want more info about wave data, after you clicked on each individual buoy in NDBC website and then clicked on "view details", scroll down the page to the end, you see the "Description of Measurements" link, click on the link and see the descriptions. FYI, @AliciaBentley-NOAA

DanielAdriaansen commented 2 months ago

Thanks @SamiraArdani-NOAA! Success- I finally found a site in Lake Ontario that had recent data and grabbed a new GLWU forecast file:

DEBUG 2: Processing wch(2,*) versus WVHT/Z250-0, for observation type NDBC_STANDARD, over region FULL, for interpolation method NEAREST(1), using 10 matched pairs.
DEBUG 3: Number of matched pairs   = 10
DEBUG 3: Observations processed    = 20454
DEBUG 3: Rejected: station id      = 0
DEBUG 3: Rejected: obs var name    = 18993 
DEBUG 3: Rejected: valid time      = 1445
DEBUG 3: Rejected: bad obs value   = 6
DEBUG 3: Rejected: off the grid    = 0
DEBUG 3: Rejected: topography      = 0
DEBUG 3: Rejected: level mismatch  = 0
DEBUG 3: Rejected: quality marker  = 0
DEBUG 3: Rejected: message type    = 0
DEBUG 3: Rejected: masking region  = 0
DEBUG 3: Rejected: bad fcst value  = 0
DEBUG 3: Rejected: bad climo mean  = 0
DEBUG 3: Rejected: bad climo stdev = 0
DEBUG 3: Rejected: mpr filter      = 0
DEBUG 3: Rejected: duplicates      = 0
DEBUG 2: Computing Categorical Statistics.

Let me know if there's anything else, otherwise feel free to close this issue.

SamiraArdani-NOAA commented 2 months ago

@DanielAdriaansen : Great news! Thank you very much! I am so excited to use this capability of MET-12.0.0 for our EVS-GLWU component and see the verification results.

DanielAdriaansen commented 2 months ago

For future reference I found this helpful when working with GLWU: https://gmd.copernicus.org/articles/17/1023/2024/.

@AliciaBentley-NOAA @SamiraArdani-NOAA is it OK to close this issue?

AliciaBentley-NOAA commented 2 months ago

@DanielAdriaansen If GLWU unstructured data can be successfully read into MET-12.0.0 and used with both GridStat and PointStat, then I think we are good to go and that you can close this issue! @SamiraArdani-NOAA, do you agree?

SamiraArdani-NOAA commented 2 months ago

@AliciaBentley-NOAA : Agreed. Thanks!

DanielAdriaansen commented 2 months ago

Great, thanks all!

dtcenter / MET