AWS Bedrock released earlier this year their new converse API that aims to standardize their api calls to their models.
Objective
Integrate the AWS Bedrock Converse API into the Haystack integration library to allow users to leverage AWS Bedrock converse within their Haystack pipelines, paving the way potentially for easier agent development and multimodal integration.
Proposed Features
Add a new BedrockConversationGenerator node in Haystack integrations.
Support easy tool calling with some new classes to ease the process of tools definition and calling.
Support streaming responses from the Bedrock Converse API.
Implement error handling and retries for API calls.
Implementation Details
Use the AWS SDK for Python (Boto3) to interact with the Bedrock Converse API.
Follow Haystack's node implementation guidelines for consistency.
Integrate AWS Bedrock Converse API into Haystack
Background
AWS Bedrock released earlier this year their new converse API that aims to standardize their api calls to their models.
Objective
Integrate the AWS Bedrock Converse API into the Haystack integration library to allow users to leverage AWS Bedrock converse within their Haystack pipelines, paving the way potentially for easier agent development and multimodal integration.
Proposed Features
BedrockConversationGenerator
node in Haystack integrations.Implementation Details
Resources
Alternatives
This could also be a feature for the existing AmazonBedrock generators instead of a new one.