search

cal-itp / data-infra

Cal-ITP data infrastructure
https://docs.calitp.org/data-infra
GNU Affero General Public License v3.0
48 stars 12 forks source link

Bug: Populate new columns from airtables transit services to bigquery #3487

Open vevetron opened 4 days ago

vevetron commented 4 days ago

Describe the bug

Due to the way this is written, new tables don't appear in bigquery automagically: https://github.com/cal-itp/data-infra/blob/main/airflow/dags/create_external_tables/airtable/external_airtable_california_transit_services.yml

Expected behavior All the missing columns appear in bigquery!

vevetron commented 3 days ago

The column name holiday_website_status has some history and didn't work with the code, so this should fix it.