SDK in Triton Inference Server

open-mmlab / mmdeploy

OpenMMLab Model Deployment Framework

https://mmdeploy.readthedocs.io/en/latest/

Apache License 2.0

2.64k stars 611 forks source link

SDK in Triton Inference Server #870

Open Mo-Kanya opened 1 year ago

Mo-Kanya commented 1 year ago

Hi,

I'm thinking about using the MMdeploy SDK as a backend in the Triton server. It seems that many people would be interested in this usage. Do you have any plan for this or are they any related existing practices?

Best

lvhan028 commented 1 year ago

Sorry, @Mo-Kanya I haven't got enough time to study triton yet. I am afraid this issue probably still be hung for a while. I'll get back to you as soon as I figure out a proper way

Mo-Kanya commented 1 year ago

No problem. Thanks for your reply.