search

VMois / miwaitway

Calculate average wait time on bus stops using GTFS real-time vehicle location and display it on a map
https://vmois.dev/miwaitway-average-wait-time-on-stop/
3 stars 0 forks source link

Move realtime gathering of data from Airflow to a separate small container that runs 24/7 #8

Closed VMois closed 5 months ago

VMois commented 5 months ago

If Airflow is redeployed, real-time data collection will be interrupted. In addition, wasting Airflow resources might be unnecessary, as Airflow is not designed for running tasks 24/7.

Making such a service in Golang might be a good option for memory and CPU efficiency. Collecting data and saving it to GCS will be enough.