anthropics / anthropic-sdk-python

MIT License
1.31k stars 158 forks source link

Bedrock Frequently Has Server-side Errors #432

Open kevinlu1248 opened 5 months ago

kevinlu1248 commented 5 months ago

Likely unrelated to the client but I'm getting this pretty frequently on Anthropic Bedrock.

anthropic.APIStatusError: Error code: 424 - {'message': 'The system encountered an unexpected error during processing. Try your request again.'}

Also, it seems like this replace the other issue from: https://github.com/anthropics/anthropic-sdk-python/issues/418, so that issue should be resolved now.

costa-paxton commented 3 months ago

I'm also coming up against this error though Bedrock. Would it make sense to simply add handling for 424 in BaseClient._should_retry?

rattrayalex commented 3 months ago

Ah, yes, that does sound like a good idea. We'll take a look at that.