search

neokd / NeoGPT

Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy
https://neogpt.dev
MIT License
68 stars 62 forks source link

Add magic command to calculate tokens #189

Closed neokd closed 4 months ago

neokd commented 4 months ago

Add a magic command /tokens [prompt] allowing user to calculate the number of tokens for a given prompt. Use tiktoken for calculating the number of tokens

ayushmorbar commented 4 months ago

Assign me this issue as part of JWoC.

neokd commented 4 months ago

You have done this ryt?