A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS
Added WAF to throttled the Appsync request per IP. Added one rule specific for sendQuery
Testing
Verified throttling from both cloudfront and appsync by call many time the LLM
Verified the front end still works with federation, image upload. The content ContentSecurityPolicy header is strict to prevent using unexpected resources.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Issue #, if available:
Description of changes:
CloudFrontWebDistributionis deprecatedsendQueryTesting
ContentSecurityPolicyheader is strict to prevent using unexpected resources.By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.