This talk is aimed at introducing a data architecture we have been working on - Data Mesh based on multi-hop data design pattern. Data Mesh is a decentralized sociotechnical architecture that enables domain teams to share, access, manage cross-domain data analysis on their own in complex and large-scale environments. A multi-hop data design pattern is a modern architecture for building data pipelines comprised of multiple stages so that each stage processes the data and improves the quality of the data progressively. Multi-hop architecture is compatible with the concept of Data Mesh. Combining them together could be of great help in improving data quality steadily and progressively, and reducing data silos while each domain team is autonomously cooking data products. We will introduce, in this share, a technological solution we have been working on with a simple example to showcase its concepts, principles, and data stack.
A Technological Solution To Data Mesh Based On Multi-hop Data Design Pattern賴宗智 George LaiData Innovation Tech Lead, Micron Technology