search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.81k stars 1.39k forks source link

bug: Failed to load CLIP model? #4092

Closed imtuyethan closed 18 hours ago

imtuyethan commented 1 week ago

Jan version

0.5.8-734

Describe the Bug

CLIP model fails to load with error: Failed to load model with ID "llava-7b". clip_model_load failed to load CLIP model from /Users/hanoi/.jan/models/llava/clip_tokenization_openai/openai Does the file exist?

Context (from dev):

Screenshot 2024-11-21 at 7 33 15 PM Screenshot 2024-11-21 at 7 33 01 PM

Steps to Reproduce

  1. Launch Jan
  2. Attempt to load LLaVA 7B model
  3. Observe error message about CLIP model failing to load

Screenshots / Logs

What is your OS?

louis-jan commented 2 days ago

Oh weird. This clip model is not our defined version in model.json. Users likely customized it, which is incompatible.

Failed to load model with ID "llava-7b". clip_model_load failed to load CLIP model from /Users/hanoi/.jan/models/llava/clip_tokenization_openai/openai Does the file exist?