API request limit - Githubissues

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

https://dify.ai

Other

45.3k stars 6.36k forks source link

API request limit #5931

Closed jianbo-wu-20230331 closed 2 weeks ago

jianbo-wu-20230331 commented 2 months ago

Self Checks

[X] I have searched for existing issues search for existing issues, including closed ones.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
[X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Open API requests do not have circuit breaker rate limiting set up, so if there are a lot of requests, the system is likely to crash.

2. Additional context or comments

We can set request limits for each API, and when the requests reach the limit, the API will be circuit-broken to protect the system.

3. Can you help us with this feature?

[ ] I am interested in contributing to this feature.

zhang001122 commented 2 months ago

i use the api request only for 5 tps,it dont work so how can we use it in production dify:0.6.13 error: too many requests and db overflow