Open-Data-Product-Initiative / v3.0

Open Data Product Specification 3.0
https://opendataproducts.org/v3.0/
Apache License 2.0
5 stars 4 forks source link

Replace Data Quality and SLA components with DataQoS component #66

Closed kyyberi closed 6 months ago

kyyberi commented 7 months ago

Describe the solution you'd like

I am suggesting we adopt the DataQoS concept in ODPS, https://open-data-product-initiative.github.io/DataQoS-as-code The example is not complete so it has to be developed. That Component would make Data Quality and SLA objects obsolete, yet enables the same outcome and use cases.

DataQoS can be used only for Data quality if SLA is not relevant. Also the other way around, it can be used only for SLA if DQ is not needed.

This would simplify the ODPS and also bring the Everything as Code aspect into the ODPS.

Can you submit a pull request?

Yes, I can work in this and build a pull requests. It will take a moment but yes.

---- Leave intact! Approval of Contributor Agreement -----

By submitting issue you approve the Contributor Agreement, https://governance.opendataproducts.org/v1/contributions/contributor-agreement

kyyberi commented 7 months ago

@niilahti let me know what you think

niilahti commented 6 months ago

I support the change; the current quality model is not good enough and does not promote the as Code aspect.

kyyberi commented 6 months ago

Decided to keep the SLA and Data quality still separate instead of merging all together. Perhaps in the future the two are combined. Also decided that both SLA and Data quality structure should be the same to ease the adoption.

kyyberi commented 6 months ago

the changes have been implemented to Dev version. Closing.