fix: avoid bedrock read timeout (add boto3_config param) - Githubissues

deepset-ai / haystack-core-integrations

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards

https://haystack.deepset.ai

Apache License 2.0

122 stars 120 forks source link

fix: avoid bedrock read timeout (add boto3_config param) #1135

Closed tstadel closed 1 month ago

tstadel commented 1 month ago

Related Issues

fixes running into read timeouts during model invoke (see https://repost.aws/knowledge-center/bedrock-large-model-read-timeouts)

Proposed Changes:

add boto3_config param to pass boto3 config values like read_timeout which should be set to a higher value in order to avoid read timeouts during long-running model executions

How did you test it?

Notes for the reviewer

Checklist

I have read the contributors guidelines and the code of conduct
I have updated the related issue with new insights and changes
I added unit tests and updated the docstrings
I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.