search

deepset-ai / haystack-core-integrations

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards
https://haystack.deepset.ai
Apache License 2.0
100 stars 96 forks source link

Bedrock Converse API integration #977

Open FloRul opened 4 weeks ago

FloRul commented 4 weeks ago

Integrate AWS Bedrock Converse API into Haystack

Background

AWS Bedrock released earlier this year their new converse API that aims to standardize their api calls to their models.

Objective

Integrate the AWS Bedrock Converse API into the Haystack integration library to allow users to leverage AWS Bedrock converse within their Haystack pipelines, paving the way potentially for easier agent development and multimodal integration.

Proposed Features

  1. Add a new BedrockConversationGenerator node in Haystack integrations.
  2. Support easy tool calling with some new classes to ease the process of tools definition and calling.
  3. Support streaming responses from the Bedrock Converse API.
  4. Implement error handling and retries for API calls.

Implementation Details

Resources

Alternatives

This could also be a feature for the existing AmazonBedrock generators instead of a new one.

FloRul commented 4 weeks ago

Currently working on it

lambda-science commented 3 weeks ago

Currently working on it

Following on this, it will help a lot with tool use across all AWS Bedrock models with this unified API