Streaming support on MMS

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference

Apache License 2.0

984 stars 230 forks source link

Open rauldiaz opened 1 year ago

rauldiaz commented 1 year ago

Hi!

Are there any plans to enable video streaming support into MMS (e.g., via gRPC)?

What would be the best way to enable this streaming?

Thanks.

inf3rnus commented 3 months ago

bump