Feat #159: Use correct tokenizer encoding calc based on selected LLM

devoxx / DevoxxGenieIDEAPlugin

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All and Jan) and Cloud based LLMs to help review, test, explain your project code.

https://devoxx.com

MIT License

83 stars 16 forks source link

Feat #159: Use correct tokenizer encoding calc based on selected LLM #160

Closed stephanj closed 1 week ago

stephanj commented 1 week ago