PrefectHQ / marvin

✨ Build AI interfaces that spark joy
https://askmarvin.ai
Apache License 2.0
5.3k stars 347 forks source link

Add support for Anthropic models via AWS Bedrock #644

Open cjweber opened 1 year ago

cjweber commented 1 year ago

First check

Describe the current behavior

Marvin currently supports Anthropic, OpenAI, and Azure OpenAI models. There is no way to target AWS Bedrock LLMs.

Describe the proposed behavior

The proposed behaviour is to enable targeting of Anthropic models hosted on AWS Bedrock. I am hoping this could be configured in a way such that existing Anthropic business logic can be leveraged, and integrated with configuration options in order to target one hosted on AWS Bedrock vs the Anthropic API.

Example Use

No response

Additional context

I'm happy to look into contributing if this feature is of interest. If it is not, I would like to understand why! Thank you.

Pidem commented 12 months ago

Happy to contribute to this new feature as well.

KoStard commented 10 months ago

Would be interested in this feature as well.

Dev-Khant commented 7 months ago

@zzstoatzz @jlowin Can I pick this up?