Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
16.81k stars 833 forks source link

Failed to load model, here's what came out  #399

Closed DjagbleyEmmanuel closed 1 month ago

DjagbleyEmmanuel commented 1 month ago

llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.ffn_down.weight' not found llama_load_model_from_file: failed to load model llama_init_from_gpt_params: error: failed to load model 'phixtral-4x2_8odd.Q8_0.gguf' {"function":"load_model","level":"ERR","line":447,"model":"phixtral-4x2_8odd.Q8_0.gguf","msg":"unable to load model","tid":"9442720","timestamp":1714935621}