search

AAlvAAro / ruby-amazon-bedrock

Seamless Integration with Amazon Bedrock for AI-Powered Text and Image Generation in Ruby.
MIT License
6 stars 7 forks source link

Implement invoke_model_with_response_stream #2

Open AAlvAAro opened 8 months ago

AAlvAAro commented 8 months ago

To be able to receive the LLMs response by chunks instead of a giant block of text, the invoke_model_from_response_stream AWS gem method needs to be implemented. See reference:

https://docs.aws.amazon.com/sdk-for-ruby/v3/api/Aws/BedrockRuntime/Client.html#invoke_model_with_response_stream-instance_method