search

blaylockbk / Herbie

Download numerical weather prediction datasets (HRRR, RAP, GFS, IFS, etc.) from NOMADS, NODD partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.
https://herbie.readthedocs.io/
MIT License
480 stars 72 forks source link

Feature: "Build your own GRIB file" #294

Open blaylockbk opened 6 months ago

blaylockbk commented 6 months ago

So often, I (and other users) want to work with data across many files. It would be much easier to work with that data if the GRIB messages from many files were dumped into a single file; all the data a user wants is encapsulated in a single file.

For instace

graph LR;
    A[File 1] -->|TMP:2 m| Custom_GRIB;
    B[File 2] -->|TMP:2 m| Custom_GRIB;
    C[File 3] -->|TMP:2 m| Custom_GRIB;
    D[File 4] -->|TMP:2 m| Custom_GRIB;
    Custom_GRIB[Custom GRIB];

I could probably do this looping to create Herbie objects, concat the inventories (with a column of the source URL), and then loop over curl downloads for each into the same file.