Open hookla opened 11 months ago
@hookla what is the limit?
Diff models have diff limits so should be configurable.
Got4 says
The token limit for each interaction with OpenAI's language models, like me, varies depending on the specific model and platform. As of my last update, for a ChatGPT conversation like this one, the total limit is generally around 4096 tokens, which includes both the input from the user and the responses from the AI. This typically allows for a back-and-forth conversation that can be quite extensive.
Token counter functionality should be part of the client. Chairman will check if client is running out of tokens and end the meeting