Metro-Records / la-metro-dashboard

An Airflow-based dashboard for LA Metro
4 stars 0 forks source link

Docker cleanup job is not working as expected #104

Closed hancush closed 1 year ago

hancush commented 1 year ago

We have a DAG to run docker system prune every day, cleaning up old versions of images as well as stopped containers. This is not actually doing what we expect. Resolving #103 will address containers for failed scrapes, so let's focus on clearing out old images.

I'm a bit at a loss as to why the DAG is not working, but a stopgap we could achieve quickly is to run docker system prune from a cron, instead.

hancush commented 1 year ago

This looks to be working now!