Azure-Samples / modern-data-warehouse-dataops

DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
MIT License
570 stars 451 forks source link

feat: ADR to capture how to structure parking sensor and synapse sample #405

Closed devlace closed 2 years ago

devlace commented 2 years ago

Type of PR

Purpose

Does this introduce a breaking change? If yes, details on what can break

DavidBurela commented 2 years ago

My main consideration is the ease for a final user to be able to pick it up, grok how it works, and use on their project.

sinnypan commented 2 years ago

1st preference: Option 2 Reason: Its better configuration for guiding engineers about how many components are common and how many components are dedicated for certain technology choices (Databricks/ADF vs. Synapse). And the code will become more clean and aligned to engineers who want to refer. 2nd preference: Option 3 Reason: If considering that given resources/time we had, we can decide to go with this approach for now.

jmostella commented 2 years ago

I'm leaning towards option 3 (or option2) for the reasons previously discussed:

For option 2 It looks like we have a good enumeration of the shareable components. Just wondering what the friction will be.