Thread cr3 file metadata ETL - Githubissues

cityofaustin / atd-vz-data

The technology that powers the City of Austin's Vision Zero program

https://visionzero.austin.gov/viewer/

11 stars 3 forks source link

Thread cr3 file metadata ETL #1436

Closed frankhereford closed 4 months ago

frankhereford commented 5 months ago

Associated issues

This PR aims to close https://github.com/cityofaustin/atd-data-tech/issues/16746.

Testing

Local testing for this one.

Spin up local DB and replicate production data down onto it.
Create a env file or get one from me
docker compose build
docker compose run metadata
./populate_cr3_file_metadata.py -s 100 for example. Try -h to explore the options.

Ship list

[ ] ~Check migrations for any conflicts with latest migrations in master branch~
[ ] ~Confirm Hasura role permissions for necessary access~
[ ] Code reviewed
[ ] Product manager approved

frankhereford commented 4 months ago

@mddilley wrote:

Could you add the tiniest of READMEs with this command for the next person who needs to run this locally?

Great idea, you bet! How's this look? https://github.com/cityofaustin/atd-vz-data/tree/thread-cr3-file-metadata/atd-etl/populate_cr3_file_metadata

https://github.com/cityofaustin/atd-vz-data/pull/1436/commits/0510864b7abc5ec7cedb1465fe0d0bfe496801ad