esmf-org / esmf

The Earth System Modeling Framework (ESMF) is a suite of software tools for developing high-performance, multi-component Earth science modeling applications.
https://earthsystemmodeling.org/
Other
162 stars 77 forks source link

Metadata exchange between components #232

Open anntsay opened 8 months ago

anntsay commented 8 months ago

Problem statement: although we do exchange data via connectors, the user currently right now have to use complicated workarounds to pass metadata.

This may be a nice feature to have. Maybe we could use info class. And connector can pick up Info in a field and pass it to the next step.. Or attach info to state.

This may also help with allowing component to know the source of data using meta data.

Can get more design input from CESM team since one of the challenges here is how Info would go through a variety of mediators.

anntsay commented 8 months ago

this will also allow standard for Info class.

danrosen25 commented 3 days ago

This issue was discussed when addressing https://github.com/orgs/esmf-org/discussions/314 Field metadata can be used to track _FillValue and exchange this information between components. Future use of _FillValue can be used to mask out or produce errors during regridding. Note that _FillValues without masking will be interpolated and the destination will receive values not exactly matching _FillValue, which defeats the purpose of this feature.