search

azavea / noaa-hydro-data

NOAA Phase 2 Hydrological Data Processing
11 stars 3 forks source link

Task 4-1: Develop Automatic Conversion of NWM Predictions #39

Closed lewfish closed 1 year ago

lewfish commented 2 years ago

Azavea will develop a process to convert predictions and update the corresponding Zarr and Parquet encodings to support both the initial data conversion and incremental updates.

lewfish commented 2 years ago

After our May 3 stakeholder meeting, we learned that the NWM predictions are being archived on Google Cloud at https://console.cloud.google.com/marketplace/details/noaa-public/national-water-model. This means that our job is not to archive the predictions, but to transform them in useful ways. The most important transformation is to re-chunk to support more efficient access, but people also suggested aggregating spatially and temporally as potentially useful.

elizawallace commented 1 year ago

Completed with PR #132.