CityofPittsburgh / data-rivers

Apache Airflow and Beam ETL scripts for the City of Pittsburgh's data analysis pipelines
10 stars 1 forks source link

Use File Path Generated from Direct Export in Email Task #671

Closed jasonfic closed 7 months ago

jasonfic commented 7 months ago

The Airflow task that emails the discrepancy report to HR and Police personnel was previously referencing the wrong file name in GCS - an old version of the report that stopped being used in December after the direct exports function was implemented. This update adds the trailing zeroes to the file path, which indicates that the file was generated via direct export.