josephrocca
commented
1 year ago Sorry about this - going to try fix it today. Token counts are currently an estimate, so I add a buffer, and it looks like the buffer wasn't big enough here. I've just pushed an update which increases the buffer as a temporary fix - should hopefully give you your thread back in the meantime (refresh page to get the update).
Someone on the server got a much bigger token overrun, which suggests an actual bug in context length calculation stuff, so if you get this again and it's significantly over (e.g. 4500+), please do post another comment here, and share the thread json if possible (you can DM me rocca#4242 on discord)
perkopoulos
Running tonight directly from https://josephrocca.github.io/OpenCharacters/#, I created a couple of new characters, and eventually had a very long chat with one (perhaps 200-300 message pairs? More? Hard to say). All was well, but suddenly I start getting the attached context_length_exceeded error. The length is exceeding 4097 by a very small number of tokens. The error repeats with each submission from this point on, although the token counts vary slightly. I tried deleting and resubmitting my last input, and many retries, but all now fail the same way. Switching characters to a new instance of the same AI works fine, then fails again when I switch back to the long chat. So my long chat is basically over now as a result.
The last input that first triggered this is nothing special, and is in fact rather short. So I think there's something off in your max context length calculation. I saved the thread at that point and can provide that and/or full screenshot or bot name if required.