search

european-modelling-hubs / covid19-forecast-hub-europe

European Covid-19 Forecast Hub.
https://covid19forecasthub.eu
Other
45 stars 95 forks source link

Meta data content #5

Closed kathsherratt closed 3 years ago

kathsherratt commented 3 years ago

Can we have more detailed meta data with model categories?

SF: Good idea - can someone put a link to the metadata description for the US and Germany/Poland?

seabbs commented 3 years ago

Germany is sparse: https://github.com/KITmetricslab/covid19-forecast-hub-de/wiki/Preparing-your-submission#metadata Template: https://github.com/KITmetricslab/covid19-forecast-hub-de/blob/master/template/metadata-ABC-exampleModel1.txt

kathsherratt commented 3 years ago

US forecast meta data readme

sbfnk commented 3 years ago

Suggestions for other metadata fields?

kathsherratt commented 3 years ago

I've always thought a tabular meta data would be better to make it easy to compare across teams. Will compare the above and suggest something that will give us more detail with which to ensemble / compare models.

seabbs commented 3 years ago

I assume they have some code to read this into a csv.

sbfnk commented 3 years ago

of relevance: "We don't currently check the contents of metadata files, we just check they are there. You may want to go back to the US Hub to get the relevant codes for their current format (which is probably reasonable to adopt)."

seabbs commented 3 years ago

Edit: I think the US team have code.

sbfnk commented 3 years ago

US: https://github.com/reichlab/covid19-forecast-hub/blob/master/data-processed/METADATA.md

jbracher commented 3 years ago

We don't really do much with the metadata currently (given time constraints we didn't give this as high priority as we maybe should have). So better follow the US example here. I think (but am not sure) that Zoltar also accesses metadata files, so you may want to check with Nick before making major changes here or moving to a tabular format.