NOAA-EMC / graphcast

GraphCastGFS
https://graphcastgfs.readthedocs.io/en/latest/index.html
Apache License 2.0
17 stars 6 forks source link

Calculating toa incident solar radiation as well as updating gdas_utility products unit #12

Closed SadeghTabas-NOAA closed 6 months ago

SadeghTabas-NOAA commented 7 months ago

Description

This PR updates gdas_utility.py to calculate TOA incident solar radiation based on datetime, lat, and lon using the PySolar package and puts it in the graphcast inputs. This process is parallelized, as it may take time for high resolution and longer steps.

Also, this PR updates gdas_utility.py to generate graphcast gdas inputs with the same units as ERA5 that the graphcast is trained on. Unit updated variables:

In addition, some updates have been done to resolve the memory issue due to merging a large number of nc files when we generate gdas info for 10 days (40 steps).

Linked Issues and Pull Requests

Associated GraphCast Issue to close

Blocking Dependencies

Anticipated Changes

Input data

Needed libraries

junwang-noaa commented 6 months ago

Also you mentioned using GFS for normalization, will it be a separate PR?

SadeghTabas-NOAA commented 6 months ago

Also you mentioned using GFS for normalization, will it be a separate PR?

I'd update normalization part with the script for fine tuning if its possible?

junwang-noaa commented 6 months ago

The code looks good, thanks!