fix: Improve error resilience of the Bedrock stream handling

spring-projects / spring-ai

An Application Framework for AI Engineering

Apache License 2.0

3.32k stars 850 forks source link

Closed tzolov closed 2 weeks ago

tzolov commented 2 weeks ago

The changes include:

Refactor the emitting of next, error, and complete events in the Bedrock stream handling to use a default EmitFailureHandler that retries for 10 seconds before failing. This helps improve the error resilience of the stream processing.
Disable a couple of integration tests related to the COHERE_COMMAND_V14 model, as that model version is no longer supported.
Adjust some configuration options in the Jurassic2 chat model integration test.

Also resolves #1679

ilayaperumalg commented 2 weeks ago

LGTM, merging.