search

ngruver / llmtime

https://arxiv.org/abs/2310.07820
MIT License
628 stars 139 forks source link

add suggestions for usage requirements for openAI #22

Open nickreich opened 6 months ago

nickreich commented 6 months ago

After running and debugging the demo notebook a bit I got the following error message

RateLimitError: You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.

I only have a free account on OpenAI. Could you provide in the documentation files and/or the demo notebook some indication of how much usage might be needed to run the demo script one, or, say, 10 times? I will check my usage logs (although they don't appear to be updated in real-time) but it would be helpful to have a sense of how much a run of one of these models churns through API limits, and how different model parameters might change that. Thanks!

nickreich commented 6 months ago

I'll note that I made a newbie error by not adding credit to my account initially. Once I added a small amount, the error went away. That said, my request for having the model documentation provide some info about how many requests are sent would be useful.

zaizou commented 5 months ago

@nickreich You can also try with Mistral API, it's cheaper