aiplanethub / beyondllm

Build, evaluate and observe LLM apps
https://beyondllm.aiplanet.com/
Apache License 2.0
264 stars 40 forks source link

Add Support for Bedrock Models (Amazon, Meta, Anthropic, AI21, Mistral) in BeyondLLM #84

Open Ajaykumarkv17 opened 1 week ago

Ajaykumarkv17 commented 1 week ago

This PR adds support for AWS Bedrock-compatible models to the BeyondLLM library, including:

  • Amazon Titan
  • Meta LLaMA
  • Anthropic Claude
  • AI21 Jurassic-2
  • Mistral Large Models
  • Key updates include model-specific input formatting and response parsing, enabling seamless integration with Bedrock Runtime. This enhancement expands BeyondLLM’s versatility, simplifying deployment and experimentation with a broader range of LLMs.