Add data and analytics engineering architecture to handbook

ministryofjustice / data-and-analytics-engineering

Handbook for the data and analytics engineering professions

https://ministryofjustice.github.io/data-and-analytics-engineering/

MIT License

2 stars 2 forks source link

Add data and analytics engineering architecture to handbook #24

Closed SoumayaMauthoorMOJ closed 4 months ago

SoumayaMauthoorMOJ commented 4 months ago

Added a new page about the data and analytics engineering architecture, and using context and container terminology from C4 model
Added an alternative diagram based on aws data lakehouse architecture
Made some tweaks to the About page to make sure terminology is consistent
Did some house-cleaning and deleted three duplicate files

SoumayaMauthoorMOJ commented 4 months ago

@tom-webber i've incorporated all your feedback apart from "Do we want to add shiny/python apps (hosted on cloud platform) anywhere in or after the analytics and insight section" This is because that belongs in a 6th layer, along with powerBI, under "dissemination" , but which is outside of data lake solution remit for now. However it makes me wonder whether this diagram is useful in it's present form and should be replaced with the wider "data platform solution architecture" which I'M going to raise on friday

SoumayaMauthoorMOJ commented 4 months ago

@tom-webber @bagg3rs I’ve added a context diagram to the data and analytics engineering architecture, differentiating between what data and analytics engineers do. What do you think?

bagg3rs commented 4 months ago

@SoumayaMauthoorMOJ its very useful to me!