Is streaming supported?

aws / sagemaker-inference-toolkit

Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

Apache License 2.0

370 stars 82 forks source link

Open inf3rnus opened 3 months ago

inf3rnus commented 3 months ago

Hi,

This isn't documented anywhere, or at least where I've looked.

Looking at the MMS repo's issues, I don't think it is.

But a confirmation on this/an updating of the docs would be greatly appreciated.

Thanks, Aaron