search

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
36.79k stars 14.23k forks source link

Implement retention for our CI images #10450

Open potiuk opened 4 years ago

potiuk commented 4 years ago

Description

We started pushing quite a number of images to GitHub Registry we should clean them up.

Use case / motivation

We should run a cron action that should clean-up the old images periodically.

potiuk commented 4 years ago

cc: @ad-m @turbaszek

potiuk commented 4 years ago

FYI. Unfortunately there is currently no way to delete images from Package Registry. I have open conversation and support ticket with Github Support team - but their approach is that we should move to the recently released Github Container Registry https://github.com/markdownlint/markdownlint/blob/master/.pre-commit-hooks.yaml as Package registry is deprecated.

GCR has the capability of image deleting, but it still in beta.

This would be possible but we have to solve some problems with managing per-project access (GCR is per organisation and by default the creator of the image only has permission to it. GitHub support is aware of the problem I also opened ticket to the ASF infrastructure to clarify it https://issues.apache.org/jira/projects/INFRA/issues/INFRA-20959 and get them involved. From the conversations I held, Github Support is aware of the per-project requirements and they are evaluating different options on managing the access.

potiuk commented 4 hours ago

This might be not needed any more if we implement #43268