Add new Jenkins pipeline to validate TVM CI docker images

leandron commented 2 years ago

Add new Jenkins pipeline to build TVM CI docker images:

This is a new Jenkins job that is able to validate a set of docker images. If successful, it will retag all images with a "validated" suffix, and upload them to our Docker images staging account "tlacpackstaging".
This pipeline uses the official TVM Jenkinsfile as validation mechanism, so that we always eep up with the latest changes in the TVM Jenkinsfile, automatically.
For visibility, results are posted on Discord, to notify about new validated tags or logs in case something goes wrong.

cc @jroesch @tqchen @areusch @mbrookhart

leandron commented 2 years ago

This is a follow-up on #62.

leandron commented 2 years ago

Update on this, the first set of experimental images were published with the tag 20210824-230022-2859c2039-validated .

Hence, these images are available, including lots of traceable information, such as a timestamp and the latest git ref which is included when building the images:

docker pull tlcpackstaging/ci_(cpu|gpu|lint|wasm|i386|qemu|arm):20210824-230022-2859c2039-validated
                                                                                ^^^^^^^^^
                                     This is the latest TVM reference included in this image.

Experimental job: https://ci.tlcpack.ai/job/docker-images-ci/job/daily-docker-image-validate/ (I intentionally disabled Discuss notification, as this was just experimental)

Once we get this PR reviewed and merged, I can then proceed into making the job official.

leandron commented 2 years ago

Also cc @tmoreau89

jroesch commented 2 years ago

I already talked to @leandron and @areusch a lot about this, happy to take follow up PRs but going to land to keep forward momentum.

tlc-pack / tlcpack

Add new Jenkins pipeline to validate TVM CI docker images #67