search

NOAA-OWP / wres

Code and scripts for the Water Resources Evaluation Service
Other
2 stars 1 forks source link

As a user, I want the WRES to obtain ensemble forecasts from the WRES HEFS service in the cloud #53

Open HankHerr-NOAA opened 1 month ago

HankHerr-NOAA commented 1 month ago

Putting this on our radar. The WRDS HEFS service in the Cloud is still in development, but has been deployed to their development-Cloud and is slated to be deployed by the end of this FY. I'm told it serves 30 days of data now, and hopefully 90 days in the future. I think this is enough that the WRES should be able to pull data from it, especially since we already have folks doing evaluations that are that short.

Details about the web service URL and usage are TBD. And note that we have no RFC or other user currently asking for this, though it has been mentioned in the distant past.

Thanks,

Hank

james-d-brown commented 1 month ago

I would expect/hope that there is literally nothing to do. They should not be changing the apis, for example. Perhaps we need to bundle a new cert, but hopefully not.

Anyway, there is probably relatively little incentive for users to leverage this instance over the NWCAL instance. If they removed the NWCAL instance or WRES was put in the cloud alongside it in a way that made evaluations more performant, yes, but I don't believe either of those two scenarios is impending.

james-d-brown commented 1 month ago

But I guess this could be a "1 banana" ticket to check that it works.

HankHerr-NOAA commented 1 month ago

I won't be that easy. They are moving to a more generalized framework for their APIs in the Cloud that makes use of GraphQL. I'm almost certain that will lead to a change in JSON schema. My hope is that moving forward any new service or existing service when moved the Cloud will follow the new HEFS JSON schema (assuming it is new), given ensemble data is as complicated as it gets. (Or, for existing services, the JSON will remain unchanged.)

In other words, this will likely be quite a few "bananas".

Hank

james-d-brown commented 1 month ago

Sigh, this is like the fifteenth API from WRDS.

OK, well we'll probably need to read from the new API at some point, but I would definitely put that work before this work (well, that is unavoidable, but it shouldn't be rolled up with this ticket). The HEFS service is probably the first case where it may be needed.