Open elkimek opened 2 months ago
There seems to be some issue with llava 1.6 model in llamafile 1.2.0
In downloads.xml there's a conflict between an so it still downloads llava 1.5 instead of 1.6
I found the correct model here https://huggingface.co/genevera/llamafile-llava-v1.6-mistral-7b.Q8_0 but then the benchmark throws an error "unknown argument: --host" on debug run
There seems to be some issue with llava 1.6 model in llamafile 1.2.0
In downloads.xml there's a conflict between an so it still downloads llava 1.5 instead of 1.6
I found the correct model here https://huggingface.co/genevera/llamafile-llava-v1.6-mistral-7b.Q8_0 but then the benchmark throws an error "unknown argument: --host" on debug run