search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
20.96k stars 1.21k forks source link

Unable to load models #3031

Open someusernamee opened 1 month ago

someusernamee commented 1 month ago

Just installed Jan and downloaded Llama 3 8B through Jan. The model is listed as "inactive" once downloaded, but when I try to set it to Active it refuses to do so. Should I avoid downloading models through Jan and just download them directly through Hugging Face instead?

Van-QA commented 1 month ago

hi @someusernamee, ‌Using Llama 3 8B from Ja‌n should work. Can you h‌elp us pro‌‌vide more inf‌o to inves‌ti‌gate? going through this form might help 🙏 https://github.com/janhq/jan/issues/new?assignees=&labels=type%3A+bug&projects=&template=bug_report.yml&title=bug%3A+%5BDESCRIPTION%5D