canonical / seldonio-rocks

ROCKs for Seldon Core
Apache License 2.0
0 stars 1 forks source link

Document how `mlserver-*` images are built upstream #62

Closed orfeas-k closed 11 months ago

orfeas-k commented 11 months ago

Context

Most of the seldonio ROCKs correspond to images that are Inference Runtimes that allow you to define how your model should be used within MLServer.

The unusual with those ROCKs is that they are all based of the same Dockerfile.

How they are built upstream

This way, multiple release artefacts are produced ensuring there is a "Docker image for each Inference Runtime containing only that specific runtime" (corresponding to the mlserver-* ROCKs) while also there also a "Docker image containing every inference runtime maintained within the MLServer repo" (corresponding to the mlserver ROCK).