equinor / fmu-dataio

FMU data standard and data export with rich metadata in the FMU context
https://fmu-dataio.readthedocs.io/en/latest/
Apache License 2.0
10 stars 15 forks source link

Require content as input argument #277

Open perolavsvendsen opened 1 year ago

perolavsvendsen commented 1 year ago

Currently, content is not a required input argument. It will default to depth if not given. Also, content is white-listed. This leads to pollution of the stored data in Sumo, where anything not currently present in the list becomes depth. In many cases, this is meaningless. At the same time, content is a key attribute for reading data. This will quickly lead to some very nasty patterns.

Example from a current implementation: RFT-data is exported with content: depth.

Possibly, we need also to look at the whitelisting of content. Is it feasible that we will cover all possible contents? Probably not, and this will lead to people exporting with wrong content.

Suggest to change white-list to list of "known" content, enforce rules on known content, but still allow other content.

perolavsvendsen commented 1 year ago

Suggested:

perolavsvendsen commented 1 year ago

This links to discussion around data products

perolavsvendsen commented 1 year ago

May need to still default content but then it should be to something clearly "wrong", e.g. "unknown" or "not-set" or something like that.

perolavsvendsen commented 8 months ago

Current state:

Ref discussions with @tnatt - possibly time to enforce this more now?