BerriAI / reliableGPT

Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
MIT License
623 stars 33 forks source link

Handling context window errors -> embedding function #4

Open krrishdholakia opened 1 year ago

krrishdholakia commented 1 year ago

Add a way to handle the context window error from embedding functions.

Simple strategy -> if it's more than the context window, split it in half. Keep retrying until it fits within the context window.