search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
19.39k stars 982 forks source link

More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream #402

Open kinchahoy opened 4 months ago

kinchahoy commented 4 months ago

Could we get LLamafiles for a few more small scale (i.e. ARM friendly) LLava models? If there are instructions to use the LLava 1.5 file to load projection weights from those models that would be just as useful!

Manamama commented 4 months ago

Not sure what you mean, but these Llava models have been working fine on my Droid for +2 months. Just use their GGUF versions, e.g. https://huggingface.co/ZiangWu/MobileVLM_V2-1.7B-GGUF, with the regular syntax.

kinchahoy commented 4 months ago

Do you have llamafiles for these models? Could you share?