search

aws-samples / bedrock-access-gateway

OpenAI-Compatible RESTful APIs for Amazon Bedrock
MIT No Attribution
124 stars 24 forks source link

multiple API keys and quota per key? #18

Closed yangcheng closed 1 month ago

yangcheng commented 1 month ago

Is your feature request related to a problem? Please describe. How do I have multiple API keys and apply different quota and throttle limit per key?

daixba commented 1 month ago

I am afraid this will not be supported.

To have multiple API Keys is easy, but you will need to customize the code. Check the auth.py file for more details. To apply different quota per key is not supported by Bedrock. You can do some basic monitoring and alarm of usage via CloudWatch.

The recommendation is not to use this solution for complex cases.

yangcheng commented 1 month ago

ok, make sense