Unable to increase max token size

getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

https://apps.umbrel.com/app/llama-gpt

MIT License

10.73k stars 696 forks source link

Open Usgupta opened 4 months ago

Usgupta commented 4 months ago

Hi i am trying to increase the token size of llama and codellama, and i am unable to do so.