zhu327 / gemini-openai-proxy

A proxy for converting the OpenAI API protocol to the Google Gemini Pro protocol.
MIT License
504 stars 92 forks source link

Feature request: Checking for Rate limiting blocking (error 429) and throttling back requests. #31

Closed DIGist closed 2 months ago

DIGist commented 2 months ago

Hi!

Love the tool!

I hit a rate limit and received error 429 when working with a project..

Could you implement request throttling or request backoff delay to help alleviate the problem?

Feature request: Checking for Rate limiting blocking (error 429) and throttling back requests.

zhu327 commented 2 months ago

I won't implement this feature. This tool only does forwarding. If you have a demand, you can fork and implement it yourself