bentoml / Yatai

Model Deployment at Scale on Kubernetes 🦄️
https://bentoml.com
Other
789 stars 69 forks source link

how to deploy with cutom-runner #502

Open johnwayne19860314 opened 8 months ago

johnwayne19860314 commented 8 months ago

the company's project is using yolov5 and deep sort models. we did not store these two model in bentoml model store, but call them by self-defining a runner which inherit the bentoml.Runnable. it is ok to start by calling the command of bentoml serve. but cannot push and deploy in yatai for there is no mode stored and pushed. Could anyone inform how to store these models in the format of bentoml ? or bentoml can only work on single stored model and not on multi-model project?

parano commented 8 months ago

Hi @johnwayne19860314 , two ways you can do that in BentoML: