Azure-Samples / modern-data-warehouse-dataops

DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.

MIT License

570 stars 451 forks source link

Feat/cddp/508 cddp new customer onboarding guide #541

Closed maye-msft closed 2 years ago

maye-msft commented 2 years ago

Type of PR

Code changes
Documentation changes

Purpose

Add template to create application and customer
Add python script to create pipeline with template
Add doc in README

Validation steps

create new application and customer with the following script

python -m cddp_solution.common.utils.create_pipeline_from_template simple_template app_1 customer_1 ./tmp

Test the new customer app with steps show in the README generated in the customer app's folder.

python -m cddp_solution.common.master_data_ingestion_runner app_1 customer_1

python -m cddp_solution.common.master_data_transformation_runner app_1 customer_1

python -m cddp_solution.common.event_data_transformation_runner app_1 customer_1

python -m cddp_solution.common.master_data_curation_runner app_1 customer_1

python -m cddp_solution.common.event_data_curation_runner app_1 customer_1

gary918 commented 2 years ago

@maye-msft thanks for adding the onboarding tool. Would you submit this PR to feat/config_driven_data_pipelines ?