search

USEPA / Stormwater-Management-Model

Dynamic hydrology-hydraulic water quality simulation model
231 stars 173 forks source link

Optional output and model state persistence using HDF5 #159

Open cbuahin opened 7 months ago

cbuahin commented 7 months ago

HDF5 provides an open-source self-describing, transparent, efficient, and portable way for storing heterogenous data. It is fast becoming the de facto standard for storing and organizing large scientific datasets. This effort will involve implementing a way to optionally write swmm output and model state in the HDF5 format. This will greatly facilitate several applications and options users have long asked for including more detailed summary of diagnostic information (e.g. #32 ), saving optional periods (#156 ), prescribing model state externally for digital twin development applications, etc.

bemcdonnell commented 7 months ago

@cbuahin, love this idea. I’ve been wrong more times than I can count but would this support the ability to read data from the output while the simulation is iterating? I think we talked about this before … but I can’t remember

cbuahin commented 7 months ago

Definitely did. I forgot to add the one benefit you have correctly highlighted. The ability to read the output and track the simulation while it is running will be a huge benefit.