Support for Claude models hosted at AWS Bedrock in API channels

[MurphyLo]

例行检查

• [x] 我已确认目前没有类似 issue
• [x] 我已确认我已升级到最新版本
• [x] 我已完整查看过项目 README，已确定现有版本无法满足需求
• [x] 我理解并愿意跟进此 issue，协助测试和提供反馈
• [x] 我理解并认可上述内容，并理解项目维护者精力有限，不遵循规则的 issue 可能会被无视或直接关闭

功能描述

Provide access to the models hosted at AWS Bedrock using IAM profiles and keys. Since Anthropic doesn't give out many Claude API keys, this is a viable alternative to people wanting Claude.

Reference

• Anthropic Anouncement: Claude on Amazon Bedrock now available to every AWS customer
• Anthropic Doc: Amazon Bedrock API
• (Amazon Bedrock) Setting up the Amazon Bedrock API
• (Amazon Bedrock) Running inference on a model

[AutoJunjie]

Hi Murphy, 请问您正在开发这个功能吗？我这边也有需求，我可以帮忙一起弄

[MurphyLo]

可以使用 litellm 中转 mistral 的 api 后，在 one-api 上设置代理地址为本地 litellm 端口。具体使用的是 LiteLLM 的 OpenAI Proxy Server，参考链接：

• LiteLLM - OpenAI Proxy Server
• LiteLLM - Supported Models & Providers, Mistral AI API

[0x5c0f]

需求+1

[KyleZhang0536]

需求+1

[songquanpeng]

Definitely should support this, but I need a key for testing purpose.

[0x5c0f]

Definitely should support this, but I need a key for testing purpose.

我可以提供，但如何联系你呢？

[AreChen]

需求+1,现在AWS bedrock 有claude3,使用非常方便,希望可以添加这个功能 Requirement +1, now AWS bedrock has claude3, which is very easy to use. Hope this feature can be added.

[Elric-pp]

Definitely should support this, but I need a key for testing purpose.

Are you working on it? I got key and I'd be glad to dive in

[liuhetian]

需求+1，AWS的bedrock 功能可以参考llm，https://docs.litellm.ai/docs/providers/bedrock

[pzpupu]

需求+1，目前开发进度如何，有开发分支吗？我可以协助一起开发

[Lseven-zzw]

需求+1

[dimsky]

+1

[yf319]

需求+1

[limour-blog]

需求+1