ministryofjustice / data-catalogue

Data catalogue • This repository is defined and managed in Terraform
MIT License
2 stars 0 forks source link

Agree plan for Schedule GitHub Actions processes #198

Open seanprivett opened 3 months ago

seanprivett commented 3 months ago

These have been run manually up to now. Should run on a schedule. Requires optimisation and recursion error fixes to be in place before this happens.

Agree schedule time. Do we have monitoring and alerting plugged into this process?

Agree plan for schedule Agree what time to schedule CaDeT and Justice Data ingestions

LavMatt commented 2 months ago

Going to implement this ingestion schedule at least until we have an optimised ingestion for dbt/cadet

LavMatt commented 2 months ago

discussion here on issue around deployments needing a manual approval https://mojdt.slack.com/archives/C03QZ776JVA/p1723618422292919

We'll need to decide how we get around this to run ingestions on a schedule