Allow me to summarize + embed 200 chunks of a document at once, without failing

BerriAI / reliableGPT

Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors

MIT License

623 stars 33 forks source link

Closed krrishdholakia closed 1 year ago

krrishdholakia commented 1 year ago

Biggest issue / painpoint:

I have code samples
each code sample needs to be summarized
each summary is then embedded
- I face rate-limiting errors when i try and do this with tenacity
- errors cause my loop to crash, so i need to re-run / figure it out again.

Can you let me run this loop without worrying about it crashing?

krrishdholakia commented 1 year ago

krrishdholakia commented 1 year ago

I believe the batch request function added in this PR should be able to help with this - https://github.com/BerriAI/reliableGPT/commit/a41b121f6a00a3bf2b88ff814cce818efcd11288