StreamingAttribute Session Variable Support for LLM

aws-solutions / qnabot-on-aws

AWS QnABot is a multi-channel, multi-language conversational interface (chatbot) that responds to your customer's questions, answers, and feedback. The solution allows you to deploy a fully functional chatbot across multiple channels including chat, voice, SMS and Amazon Alexa.

https://aws.amazon.com/solutions/implementations/aws-qnabot

Apache License 2.0

401 stars 253 forks source link

StreamingAttribute Session Variable Support for LLM #712

Open ashjnaik opened 7 months ago

ashjnaik commented 7 months ago

Support of Lex Streaming requires attributes to be propagated from LexWebUI to QNAbot to EmbeddingPlugins stack. The code needed to be enhanced to help propagate the same. Added parameters to be sent . These parameters are being set in the LexWebUI

abhirpat commented 7 months ago

Thanks you @ashjnaik for your contribution! We will review and get back to you.