search

microsoft / Azure-Analytics-and-AI-Engagement

Azure Analytics and AI Engagement
Other
140 stars 120 forks source link

Automate creating and initial import of all tables #66

Closed daronyondem closed 4 years ago

daronyondem commented 4 years ago

All tables from original SQL Pool will be created as part of the automation and their data will be populated as well. Data from the original environment can be exported with temporary pipelines into a CSV file into the data lake. Once these files are ready please let me know so that we can move the original CSV files into permanent storage (solliance storage account). Automation script will use CSV files from solliance storage account to load into tables during automation.

KmrShiv commented 4 years ago

why do you want to import all tables from original SQL pool in csv files?

daronyondem commented 4 years ago

We will host the CSV files in solliance storage and use the automation script to load CSV files into tables. That's the exact same process we used in retail.

xor-ranavikrant commented 4 years ago

https://github.com/microsoft/Azure-Analytics-and-AI-Engagement/files/5103153/WWI.App.Powerbi.Resources.xlsx This might help finding the relevant tables @KmrShiv

daronyondem commented 4 years ago

Meeting note from 8/24 This is now waiting for #80 to be completed.

RonStoehr commented 4 years ago

@abhishekmishra1783 Abhishek will research which reports are needed