search

getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
https://apps.umbrel.com/app/llama-gpt
MIT License
10.73k stars 696 forks source link

Only works with cuda the 7b model #138

Open eduardobb opened 9 months ago

eduardobb commented 9 months ago

The only model that works with cuda is 7b ¿why?