Fetch NLDAS drivers for large footprint

DOI-USGS / lake-temperature-lstm-static

Predict lake temperatures at depth using static lake attributes

Other

0 stars 3 forks source link

Fetch NLDAS drivers for large footprint #5

Open AndyMcAliley opened 2 years ago

AndyMcAliley commented 2 years ago

We'll need NLDAS drivers - preferably for all lakes in lake-temperature-model-prep. For this repository they'll be necessary to have on HPC resources. It'd be nice to have to option to download them locally as well, but not critical.

It would also be good to use hashing/version control for them.

Previously, those were stored locally and transferred manually wherever they were needed. Are there better solutions for us?

AndyMcAliley commented 2 years ago

Tagging @jread-usgs

jordansread commented 2 years ago

We have the drivers used in Jared's CONUS ES-LSTM paper up on Caldera, which was transferred via globus. We could either use those as-is, or use the output files from Jared's data release (which are on public S3), or another option. The drivers for that paper aren't quite the full set of what we use for GLM, though.

I agree that versioning and/or hashing these would be :+1:

AndyMcAliley commented 2 years ago

Addressed by #36, using existing files on Caldera but without hashing or versioning yet.