search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
16.81k stars 834 forks source link

Terminated by signal SIGILL (Illegal instruction) #377

Open DjagbleyEmmanuel opened 2 months ago

DjagbleyEmmanuel commented 2 months ago

Trying to run Phi and i got this error './llamafile-0.8.1 -m phi-2-unce…' terminated by signal SIGILL (Illegal instruction) Even after conversion to llamafile, i still got this error. Someone kindly explain to me why please, thank you

mnassAN commented 2 months ago

me too - Ubuntu 23.10 - Command: "./llava-v1.5-7b-q4.llamafile" script ends with "illegal instruction"

Last lines in log:

[1714233021] [llama.cpp/llava/clip.cpp:  143][             get_key_idx] key clip.vision.mm_patch_merge_type not found in file
[1714233021] [llama.cpp/llava/clip.cpp:  143][             get_key_idx] key clip.vision.image_crop_resolution not found in file
[1714233021] [llama.cpp/llava/clip.cpp: 1308][         clip_model_load] clip_model_load: compute allocated memory: 32.89 MB
[1714233022] warming up the model with an empty run