finos / architecture-as-code

"Architecture as Code" (AasC) aims to devise and manage software architecture via a machine readable and version-controlled codebase, fostering a robust understanding, efficient development, and seamless maintenance of complex software architectures
https://finos.github.io/architecture-as-code/
Apache License 2.0
34 stars 17 forks source link

Data Catalog / Lineage integration #84

Open ojeb2 opened 3 months ago

ojeb2 commented 3 months ago

Feature Request

Description of Problem:

We want to capture data architecture design decisions in CALM by understanding how Data Catalogs and Data Lineage can be integrated with CALM.

When capturing a system or solution design in CALM, I want to represent which data assets are owned by which systems, how data assets flow through the solution and which data concepts a system supports, so that we can understand how the solution will process data.

Potential Solutions:

We can potentially use the information model from CDMC to represent Data Asset and Data Lineage data in a number of popular metadata formates including DCAT, PROV, Egeria, Atlas, DPROD. The CDMC information model allows the translation between formats supported by multiple data management tools. By identifying which CDMC concepts relate to data asset definitions, information classifications, authoritative sources, data sharing agreements, lineage, and provenance, we can extend CALM with a rich set of data architecture definitions.

rocketstack-matt commented 3 months ago

Tag: @arhy