Open jibinmathew69 opened 6 months ago
I'm hoping they increase their rate-limits soon. Someone's working on an OpenAI PR which should help on the other side - for now restarting should continue the generation with nothing else changed though.
What would be a good solution here? I considered adding retries, but most of Anthropic's rate limits are tiny so sometimes you're locked out for a lot longer than a few seconds.
@jibinmathew69 the latest PR #14 allows you to use OpenAI, which should have higher rate limits and make this more manageable!
The output breaks on hitting rate, is there a recommended tier? I have been trying on tier 1.