sentinel-energy / friendly_data

Data format to interoperate between models and frameworks
https://sentinel-energy.github.io/friendly_data/
Apache License 2.0
12 stars 2 forks source link

Similar concepts for your reference #7

Open willu47 opened 4 years ago

willu47 commented 4 years ago

Hi, I'm following the project as I am keen to see where this goes. I'm using Tabular Datapackages to hold input (and eventually) output data for OSeMOSYS with data conversions facilities provided by otoole. See a working prototype here.

In a project at University of Oxford we hard linked multiple models together using a Python package we developed called smif. You might be interested in the approach we took for dealing with the metadata. While we didn't get as far as using Tabular DataPackages, we stored all metadata in YAML and had a reasonable structure to record units, spatial and temporal dimensions for model inputs, outputs and so on. In addition, we built an architecture in smif which converted this hard linked model into a linear workflow which could be sent to a scheduler, including automated (but customisable) conversions of spatial and temporal scales. It might be worth a look!

An application of smif can be seen in NISMOD2.