search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.74k stars 1.38k forks source link

bug: Model size not displaying when importing from Hugging Face #4091

Open imtuyethan opened 4 days ago

imtuyethan commented 4 days ago

Jan version

0.5.8-736

Describe the Bug

When importing models from Hugging Face, the model size is not displayed in the UI:

Screenshot 2024-11-22 at 12 12 07 AM

Steps to Reproduce

  1. Import model from: https://huggingface.co/latestissue/rwkv-6-world-1b6-gguf
  2. Observe model list in Jan UI
  3. Note that some models like RWKV show "-" for size while others display size (e.g., Zephyr shows 2.77GB)

What is your OS?

louis-jan commented 20 hours ago

The problem appears to be related to the cortex.cpp file downloading an update. We are taking a look at this.