Open 0wwafa opened 4 weeks ago
I downloaded the out.zip from the release. then I did: \bin\server -m Mistral-7b-Instruct-v0.3.f16.q4.gguf -c 4096 -t 6 --mlock --path \chatbotui\out\
also.. for some reason does not work with "aya": \bin\server -m aya-23-8B.Q4_K_M.gguf -c 4096 -t 6 --mlock --path \chatbotui\out\
Update: I changed the default locale in next-i18next.config.js and now it's in english... but shouldn't it take it automatically from the browser?
I downloaded the out.zip from the release. then I did: \bin\server -m Mistral-7b-Instruct-v0.3.f16.q4.gguf -c 4096 -t 6 --mlock --path \chatbotui\out\
also.. for some reason does not work with "aya": \bin\server -m aya-23-8B.Q4_K_M.gguf -c 4096 -t 6 --mlock --path \chatbotui\out\