Closed machow closed 2 years ago
Feel free to move all the file tracking tasks into their own dag (that depends on past)
helpful notes from Chris--there are 4 jobs being done here (should also have 4 dags):
@holly-g this would have gone to Chris C, so will have to wait until Jarvus brings in a data engineer (or I pick it up)
TO document:
I'm not sure if these were missed when I was loading 6 months ago, or were recently added to the docs, but there are 3 files we currently don't load into the warehouse.
It looks like relatively few feeds use these files right now (but analyzing e.g. pathways will likely be increasingly important).
In order to load these, we need to...
gtfs_schedule_type2.{table_name}
Completing this would resolve https://github.com/cal-itp/data-infra/issues/180