search

anthropics / anthropic-sdk-typescript

Access to Anthropic's safety-first language model APIs
https://www.npmjs.com/package/@anthropic-ai/sdk
MIT License
636 stars 69 forks source link

Support prompt caching in bedrock API (@anthropic-ai/bedrock-sdk) #507

Open fcOSENSE opened 3 weeks ago

fcOSENSE commented 3 weeks ago

https://github.com/anthropics/anthropic-sdk-typescript/blob/main/tests/api-resources/beta/prompt-caching/messages.test.ts I can not use this sample code by using @anthropic-ai/bedrock-sdk package, so does this package will update ?

RobertCraigie commented 3 weeks ago

The Bedrock API does not yet support prompt caching. The SDK will be updated when it does.

FrancescoSaverioZuppichini commented 2 weeks ago

The Bedrock API does not yet support prompt caching. The SDK will be updated when it does.

ETA? I mean you guys collaborate with them was wondering if you know something

RobertCraigie commented 2 weeks ago

Unfortunately I don't have an ETA to share. I'll re-open this issue so you can be notified when support is added!

willblaschko commented 6 days ago

Is the issue that AWS doesn't support it yet?