opencdms-dev / pyopencdms-old

⭐🐍 pyopencdms aims to build a common Python API on top of multiple Climate Data Management Systems (CDMS) that use different underlying database engines
MIT License
4 stars 6 forks source link

Example case-study of real-time mapping from a supported CDMS to OpenCDMS domain models #90

Closed isedwards closed 1 year ago

isedwards commented 1 year ago

As an OpenCDMS developer, I want an example case-study of implementing real-time mappings from a supported CDMS to the CDM using a provider plugin.

isedwards commented 1 year ago

Hey team! Please add your planning poker estimate with Zenhub @chinedu117 @david-i-berry @scottylad501

isedwards commented 1 year ago

SQL Models may be created as SQL SELECT statements and placed in the /opencdms/provider/surface/models directory of the new pyopencdms repository.

In the near future we will use DBT to 'materialize' the SQL models as views in the required database (in the meantime they can be deployed manually wrapped in CREATE VIEW statements).

Acceptance tests

Automated tests should confirm that data (from https://github.com/opencdms/opencdms-test-data/issues/48) is being correctly transformed to the CDM schema.