cal-itp / data-infra

Cal-ITP data infrastructure
https://docs.calitp.org/data-infra
GNU Affero General Public License v3.0
47 stars 12 forks source link

Bug: fact daily feed files never has parse_error of true #849

Closed machow closed 2 years ago

machow commented 2 years ago

image

I think this is related to #848, looking back at the airflow logs, when we implemented #693 I think we ended up skipping attempting to parse the feed that was failing before (due to a parse error). Once we address #848, let's double check that we have entries for this query:

SELECT * FROM `cal-itp-data-infra.gtfs_schedule_history.calitp_feed_tables_parse_result`
WHERE parse_error_encountered
evansiroky commented 2 years ago

This appears to have been fixed by #872