ScottLogic / prompt-injection

Application which investigates defensive measures against prompt injection attacks on an LLM, with a focus on the exposure of external tools.
MIT License
11 stars 8 forks source link

Remote throttling #280

Open gsproston-scottlogic opened 9 months ago

gsproston-scottlogic commented 9 months ago

May have to throttle user activity once the app is deployed.

chriswilty commented 8 months ago

AWS ECS can do this for us. Additionally, cloudfront and/or apigateway have throttling and other security measures we can enable.

https://docs.aws.amazon.com/elasticloadbalancing/latest/application/application-load-balancers.html https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/distribution-web-awswaf.html