search

aws / aws-lambda-python-runtime-interface-client

Apache License 2.0
254 stars 71 forks source link

Support Response Streaming #100

Open limcheekin opened 1 year ago

limcheekin commented 1 year ago

Hi there,

Did the runtime interface client support streaming response as per announced? https://aws.amazon.com/blogs/compute/introducing-aws-lambda-response-streaming/

If no, appreciate your sharing is there any near-term plan to work on it?

Thank you.

devesch commented 8 months ago

I'd like to see the streaming response in python too!!

pprados commented 6 months ago

With tools like LLM, the support is important. Else, it's not possible to use a lambda to return a stream of text.