jozu-ai / kitops

Tools for easing the handoff between AI/ML and App/SRE teams.
https://KitOps.ml
Apache License 2.0
266 stars 26 forks source link

init container for ModelKits #369

Open gorkem opened 2 weeks ago

gorkem commented 2 weeks ago

Describe the problem you're trying to solve Using init containers to prime the inference engine with the model artifacts is a commonly used pattern for running models on a Kubernetes cluster. However, there is currently no trusted, maintained, and secure init container image available that can be easily used by ModelKit users.

Describe the solution you'd like Create an init container with provenance and signing capabilities. The container should be configurable to unpack specific parts of the ModelKit to designated locations. The container should do signature verification when signatures are available. We should provide a container for each version of the Kit CLI, starting with the current one. Additionally, comprehensive documentation should be available, including examples of how to use the init container effectively.

Describe alternatives you've considered

Additional context