Add external table script and notebook to view external table
Documentation changes
Code changes
deploy_synapse_artifacts.sh: Add upload SQL Script function to upload sql script to synapse workspace
04_explore_interim.ipynb: Notebook to explorer data when external db, view and user has been setup correctly
create_db_user.sql: Need to run within the deployment. Need sp or user with SQL admin role and replace username and password while deploying.
create_external_table_template.sql: Need to run this script after there is data folder in data/interim=> To solve this, either create folder in advance in deployment or need to run pipeline first then run this sql script
Test changes
CI-CD changes
GitHub Template changes
Purpose
This pr is to have sql script to create external table and have a notebook to view it. Deployment is not included in the task, but has been added script in deploy_synapse_artifacts.sh to use restapi to upload sql script
Note: Might still need to modify once sql serverless schema/tables/views deployment has been decided
Does this introduce a breaking change? If yes, details on what can break
Author pre-publish checklist
[ ] Added test to prove my fix is effective or new feature works
[ ] No PII in logs
[ ] Made corresponding changes to the documentation
Type of PR
Add external table script and notebook to view external table
Documentation changes
Code changes deploy_synapse_artifacts.sh: Add upload SQL Script function to upload sql script to synapse workspace 04_explore_interim.ipynb: Notebook to explorer data when external db, view and user has been setup correctly create_db_user.sql: Need to run within the deployment. Need sp or user with SQL admin role and replace username and password while deploying. create_external_table_template.sql: Need to run this script after there is data folder in data/interim=> To solve this, either create folder in advance in deployment or need to run pipeline first then run this sql script
Test changes
CI-CD changes
GitHub Template changes
Purpose
Does this introduce a breaking change? If yes, details on what can break
Author pre-publish checklist
Validation steps
Issues Closed or Referenced