Closed fenixlam closed 2 months ago
That is not a mmproj file. You are attempting to load a base model as a projector. The mmproj file should be less than 1gb.
Really surprised by the answer, and then I searched huggingface again and found another file. https://huggingface.co/ChaoticNeutrals/Llava_1.5_Llama3_mmproj It works with llama3, really appreciate that. ^_^
I have checked the sha256 and confirm the llava file does not broken. the llava file is downloaded from: (https://huggingface.co/djward888/llava-llama-3-8b-v1_1-Q4_0-GGUF/blob/main/llava-llama-3-8b-v1_1.Q4_0.gguf) My computer is a GDP4 with 32GB ram, it use AMD 6800U with iGPU, so it shares ram with 3GB vram to load the models. I have try this in mistral 7B with its llava and it run without problem. I wonder if the error is created by memory limit or anything else.
Besides this, when I see the "enable sound, press play" in the 1.63 release page, I do really believe the application begin support sound or music generation, hahahahaa....