Closed damonmcc closed 3 months ago
related to https://github.com/NYCPlanning/data-engineering/issues/660
The python packages in requirements.txt were chosen because:
requirements.txt
dbt
boto3
minio
related to https://github.com/NYCPlanning/data-engineering/issues/660
The python packages in
requirements.txt
were chosen because:dbt
cli and project structure to validate data and run sql queries.boto3
in python to download files from Digital Ocean spaces (although theminio
cli might work).