Look into optimizing the token size calculation for the context_window

kardolus / chatgpt-cli

ChatGPT CLI is a versatile tool for interacting with LLM models through OpenAI and Azure, as well as models from Perplexity AI and Llama. It supports prompts and history tracking for seamless, context-aware interactions. With extensive configuration options, it’s designed for both users and developers to create a customized GPT experience.

MIT License

567 stars 39 forks source link

Look into optimizing the token size calculation for the context_window #73

Closed kardolus closed 1 month ago

kardolus commented 1 month ago

I feel like I cut some corners on how the token size is calculated for the context_window.

kardolus commented 1 month ago

Unfortunately there is still no Go SDK. Let's stick with the current estimation.