-
I tried two gguf conversion on M2 ultra (metal) but no luck. I converted them myself and still the same error.
Here is the first model I tried:
https://huggingface.co/guinmoon/MobileVLM-1.7B-GGUF…
-
### #
- [ ] I have searched the existing issues
### Current behavior
error log below
btw. same model and same mmproject-file works with koboldcpp , may you can copy paste ;)
### Minimum repro…
-
I'm trying to install llama-cpp-python through `CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python` but met this error. Any suggestion?
```
× Building wheel for llama-cpp-python (pyproject.…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Hello everyone,
My problem is when I run the inference example llava.eval.run_llava I get the error:
python -m llava.eval.run_llava
--model-name /app/LLaVA-Med/checkpoints/LLaVA-Med-7B
--image-fil…
yihp updated
4 months ago
-
### What is the issue?
Your branch is up to date with 'origin/minicpm-v2.5'.
Already on 'minicpm-v2.5'
Submodule path '../llama.cpp': checked out 'd8974b8ea61e1268a4cad27f4f6e2cde3c5d1370'
Checkin…
-
I have been playing with most multimodal models based on LLaVA models and I can tell that mini Gemini (the 13B version) is one of the best if not the best for its size.
Keep on the good work and h…
-
Hi,
I am currently working with the NExT-QA dataset and I ran your code using the model meta-llama/Meta-Llama-3-8B, as GPT-3.5 and GPT-4 are not open source. Could you please provide details on the r…
-
Hi, I was trying this model here:
https://huggingface.co/MoMonir/llava-llama-3-8b-v1_1-GGUF
It also comes with some instructions on how to use it for images. Is this also possible somehow with Jla…
jrtp updated
3 months ago
-
Just recently added ci to llamafile, but would like the capability to test this setup locally, but it's not working as it appears that the binfmt_misc is missing.
### Bug report info
```plain te…