search

madebywelch / anthropic-go

Go SDK for Anthropic's Claude, a next-generation AI assistant for your tasks, no matter the scale.
Other
34 stars 16 forks source link

Possible to allow non-anthropic models with Bedrock #40

Closed saranshsaini closed 1 week ago

saranshsaini commented 3 weeks ago

The bedrock support is great, however I notice that you can only use anthropic models. Is there a reason this limitation exists? It would be awesome to be able to use all of the different models that bedrock supports.

Currently, it looks like ValidateMessageRequest and adaptModelForMessage get in the way of allowing arbitrary bedrock model usage. Is this an easy limitation to get around or does bedrock make it difficult for some reason.

saranshsaini commented 3 weeks ago

Oh it looks like each model provider has its own request config which makes it a bigger lift. This is probably a longer term goal then.