search

BuilderIO / micro-agent

An AI agent that writes (actually useful) code for you
https://www.builder.io/blog/micro-agent
MIT License
2.61k stars 206 forks source link

Add request rate limiting for users on OpenAI `Usage tier 1` #31

Open jamiehaywood opened 2 months ago

jamiehaywood commented 2 months ago

My current usage limits are pretty low (I'm not a prolific user of OpenAI API). I've not looked into the source code yet, but I suspect that micro-agent is sending more requests / using more tokens than the Usage tier 1 allows:


  • © Githubissues.
  • Githubissues is a development platform for aggregating issues.
MODELTOKEN LIMITSREQUEST AND OTHER LIMITSBATCH QUEUE LIMITS
gpt-4o
30,000 TPM
500 RPM
90,000 TPD
gpt-3.5-turbo
60,000 TPM
500 RPM
10,000 RPD
200,000 TPD
gpt-4
10,000 TPM
500 RPM
10,000 RPD
100,000 TPD
gpt-4-turbo
30,000 TPM
500 RPM
90,000 TPD
text-embedding-3-small
1,000,000 TPM
3,000 RPM
3,000,000 TPD
dall-e-3
5 images per minute
tts-1
50 RPM
whisper-1
50 RPM