ONSdigital / csvcubed

A CLI to build linked data cubes.
https://gss-cogs.github.io/csvcubed-docs/external/
Apache License 2.0
12 stars 1 forks source link

Augment Airtable utils to create Jenkins Jobs #200

Closed robons closed 2 years ago

robons commented 3 years ago

Currently the airtable-utils project automatically scans a table contained in airtables (the table is managed by the project's BAs) and automatically creates Jenkins builds for each dataset that it finds (it also creates folders inside relevant git repos too).

Airtable-utils automatically creates Jenkins jobs for each dataset against the deprecated https://ci.floop.org Jenkins instance. We don't want to stop it doing this just yet, but we want airtable-utils to additionally create new csvwlib-style builds on the newer https://ci.ukstats.dev Jenkins server.

It should create two builds per dataset:

This could be an issue for the new devops person?

Don't let perfect be the enemy of good on this one, we need something now and not in 5 months.

robons commented 2 years ago

Documentation on how to switch to using the csvcubed upload pipelines can be found here.