workflow efficiency - Githubissues

bcgov / FIT_opendatadownloader

Monitor open data, report when changes are detected

Apache License 2.0

0 stars 0 forks source link

workflow efficiency #14

Closed smnorris closed 2 weeks ago

smnorris commented 2 weeks ago

[x] can validation workflow be configured to only validate config files that have changed?
[x] can get-matrix for scheduled workflows scan the config files to see if the schedule code matches the workflow (currently all config files will spawn a job whether or not anything actually gets run) - completed by adding commandchangedetector list-configs, that includes an option for matching on schedule

smnorris commented 2 weeks ago

removed validation from push on main to more or less handle the first item. Validation and download can be tested locally per source, and validation of all files should be fine on PR. Once tool matures, updates to sources via PRs should not happen that often - and if updates to sources are quarterly or similar, all sources should be re-validated anyway.