sky-uk / kfp-operator

https://sky-uk.github.io/kfp-operator
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Reduce Quickstart Pipeline image size #346

Closed aidandunlop closed 3 months ago

aidandunlop commented 3 months ago

Context

The image size of the quickstart pipeline (docs-gen/includes/quickstart/Dockerfile) is getting quite large and subsequent updates to the TFX version increase the size:

1.12 -> 1.13 increased it to 9GB 1.13 -> 1.15 increases it to 11.4GB

It is possible to just install the tfx python package in a slim linux base image, which should reduce the size of the pipeline image and speed up build time.