Update pygrib method to account for 37 levels

LinlinCui-NOAA commented 4 months ago

Description

This PR updated pygrib method in the gdas_utility.py script to account for 37 pressure levels. Specifically, it combines two dataarray along the dimension level when levelType is isobaricInhPa and num_levels is 37.
Fixed a bug in downloading data from nomads server.
Deleted hard-coded environment variables and added an argument to let the user specify the path to credential files if environment variables are not available

Linked Issues

Closes https://github.com/NOAA-EMC/graphcast/issues/30

Blocking Dependencies

None

Anticipated Changes

None

Input data

[ ] No changes are expected to input data.
[x] Changes are expected to input data:
- [x] New input data.
- [x] Updated input data.

Needed libraries

None

SadeghTabas-NOAA commented 4 months ago

@LinlinCui-NOAA let me test this on cloud before merging

SadeghTabas-NOAA commented 4 months ago

@LinlinCui-NOAA when we run gdas_utility with pygrib method, at the end when the ICs created we should remove noaa-ncepdev-none-ca-ufs-cpldcld_37 but it doesn't, this cause issues for realtime running, please fix it

LinlinCui-NOAA commented 4 months ago

@LinlinCui-NOAA when we run gdas_utility with pygrib method, at the end when the ICs created we should remove noaa-ncepdev-none-ca-ufs-cpldcld_37 but it doesn't, this cause issues for realtime running, please fix it

@SadeghTabas-NOAA The script has this feature: https://github.com/LinlinCui-NOAA/graphcast/blob/f5a2d47cc695d6991ba417416d77f123842b8012/NCEP/gdas_utility.py#L467

And when I tested on Hera, it deleted the folder ncepdev-none-ca-ufs-cpldcld_37.

NOAA-EMC / graphcast