Update ETLS to use LDM - Githubissues

cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services

17 stars 2 forks source link

Update ETLS to use LDM #12087

Closed patrickm02L closed 11 months ago

patrickm02L commented 1 year ago

Vision Zero ETLs:

[ ] ~AFD Import ETL~
[ ] ~CR3 Narrative OCR and Diagram Extraction~
[x] CRIS Crash Import
[ ] ~EMS Import ETL~
[ ] ~Refresh DB Permissions for Read Replica~

patrickm02L commented 1 year ago

CR3 Narrative OCR and Diagram Extraction has been identified in #10655, and has it's own Issue #11731.

Considering this closed.

chiaberry commented 1 year ago

Just want to note that issue 11731 is to move the script from prefect 1 to airflow 2, I am not sure how much of it needs to be updated to be able to interact with the LDM.

patrickm02L commented 1 year ago

All but the CRIS crash import requires none of very little LDM compatibility work. For purposes of clarity this Issue will pertain to the PR 1240.