search

sblakey / llm-bedrock-anthropic

Plugin for https://llm.datasette.io/en/stable/ to enable talking with Claude Instant and ClaudeV2 models on AWS Bedrock
Apache License 2.0
34 stars 11 forks source link

Handling Claude Updates #3

Closed Will-So closed 11 months ago

Will-So commented 11 months ago

Looks like Claude 2.1 is available on Bedrock. How do we want to handle minor updates like this? One option is to keep bedrock-claude always the most up to date version and eventually add an "bedrock-claude-v2" alias once we get to v3. So for now just change this line: register(BedrockClaude("anthropic.claude-v2"), aliases=("bedrock-claude", 'bc'))

to

register(BedrockClaude("anthropic.claude-v2:1"), aliases=("bedrock-claude", 'bc'))

And also add another alias to the same model so that people who want to pin to v2 can do that:

register(BedrockClaude("anthropic.claude-v2:1"), aliases=("bedrock-claude-v2", 'bc'))

And then once we have V3, it'll look like:

register(BedrockClaude("anthropic.claude-v2:X"), aliases=("bedrock-claude-v2", 'bc')) register(BedrockClaude("anthropic.claude-v3"), aliases=("bedrock-claude", 'bc'))

Will-So commented 11 months ago

Ended up deciding people may want to pin to 2.0 as well so will currently support 2.0 as v2.0. v2 will still be latest

    register(BedrockClaude("anthropic.claude-v2"), aliases=('bedrock-claude-v2.0'))
    register(BedrockClaude("anthropic.claude-v2:1"),
             aliases=('bedrock-claude-v2.1', 'bedrock-claude-v2', 'bedrock-claude', 'bc'))

And then when we have v3, we'll designate them as: 

register(BedrockClaude("anthropic.claude-v2"), aliases=('bedrock-claude-v2.0'))
register(BedrockClaude("anthropic.claude-v2:1"), aliases=('bedrock-claude-v2.1', 'bedrock-claude-v2'))
register(BedrockClaude("anthropic.claude-v3"), aliases=('bedrock-claude-v3.0', 'bedrock-claude-v3', 'bedrock-claude', 'bc'))