microsoft / solution-accelerator-many-models

MIT License
193 stars 85 forks source link

Online endpoints for models #156

Open 04diiguyi opened 1 year ago

04diiguyi commented 1 year ago

I have multiple models trained. Meanwhile I could download those ML models. Now I would like to deploy endpoints to predict data using the models instead of using batching inferencing. Do you support such functionality? If so, can you point me to the sample code? Thanks.