Closed exciteabletom closed 1 year ago
Sometimes context gets trimmed too much due to inaccurate token estimation.
We need to switch to OpenAI's tiktoken library for this.
@moodler This also will fix the issues with #11
Sometimes context gets trimmed too much due to inaccurate token estimation.
We need to switch to OpenAI's tiktoken library for this.
@moodler This also will fix the issues with #11