pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.22k stars 863 forks source link

Kserve management api for registering new models #3325

Open matej14086 opened 2 months ago

matej14086 commented 2 months ago

I have a setup where the Kserve endpoint is mounted to PVC, which reads model files on startup and loads them.

Is it possible to register a new version of the model (after I added it to PVC) without restarting whole Kserve endpoints with other models and expanding config.properties?

Torchserve supports this use case but I can't find documentation to do it on Kserve.