search

aws-samples / aws-genai-llm-chatbot

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS
https://aws-samples.github.io/aws-genai-llm-chatbot/
MIT No Attribution
1.03k stars 308 forks source link

Feature: add Bedrock Agents as a new model interface #277

Open massi-ang opened 8 months ago

massi-ang commented 8 months ago

Currently the chat can use either a langchain model interface or idefics model interface. langchain model interface uses the selected LLM as foundation model for a Langchain Conversational or ConversationalRetriever chain depending on a RAG workspace being selected or not. idefics is triggered only by the selection of Idefics multimodal FM and allows to chat with an image.

This feature is about adding a new bedrockagent model interface to be able to chat via a Bedrock Agent. To start with, since there is currently no support for Bedrock Agents in CloudFormation and CDK, Bedrock Agent are setup independently of the solution and only referred to during the setup. Depending on the timelines for CloudFormation support, we might evaluate the need to create a custom resource.

See https://docs.aws.amazon.com/bedrock/latest/userguide/agents.html for more information about Bedrock Agents.

michaelhsieh42 commented 4 months ago

Does this help? https://github.com/aws-samples/amazon-bedrock-samples/tree/main/agents/bedrock-agent-cdk

massi-ang commented 4 months ago

Thanks Michael, this feature is already availble in the fear_bedrock_agent branch