-
### What happened?
Was trying to run android/abd_run.sh using the llava model.
### Name and Version
./llama-llava-cli --version
version: 3354 (5b0b8d8c)
built with Apple clang version 15.0…
-
I redownload this repo,and tried `transfoemers` version:`4.40.0.dev`、`4.40.0`、`4.41.2`,the result is still `['']`.
some thing i do include:
All weight i use is local weight.below is my change.
1. `…
-
**scenes:**
CLI Inference
**command:**
CUDA_VISIBLE_DEVICES=0 python3 -m videollava.serve.cli --model-path "/root/Video-LLaVA-7B" --file "/root/videos/8132-207209040_small.mp4" --load-4bit
**i…
-
### What happened?
I compiled `llama-llava-cli.exe` with Vulkan Support, I followed this document https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
I tried this commnad
`./llama-…
-
When I run
`bash scripts/video/demo/video_demo.sh ${the path of LLaVA-NeXT-Video-7B-DPO} vicuna_v1 32 2 True ${the path of video}`
I get the error
```
Can't set vocab_size with value 32000 for …
-
Hello, I am in a container created by WSL and Docker, ubuntu version is 22.04
(test) root@00a6be2423a8:/home/share/projects/llamafile# cat /etc/issue
Ubuntu 22.04.3 LTS \n \l
.cosmocc/3.3.3/bin…
-
Paddle版本:
```
python -c "import paddle; print(paddle.version.commit)"
CustomDevice: npu, visible devices count: 2
2ef8abae65f11fa3cdae784b4ac58750e0fa3bbb
```
CANN版本:`8.0.RC1`
操作系统版本:`Ubun…
yimuu updated
1 month ago
-
### What happened?
```markdown
>> cd 'G:\LLAMA-CPP\WINDOWS10ACER\llama.cpp-b3661'
>> llama-
llama-baby-llama.exe llama-gguf-split.exe llama-passkey.exe
llama-batch…
-
This is the output of the model.
python -W ignore llava/eval/run_vila.py \
--model-path Efficient-Large-Model/Llama-3-VILA1.5-8b \
--conv-mode llama_3 \
--query "\…
-
Hello,
I am trying to run the VILA model for inference, but I have encountered a couple of issues that I need help with.
(1)FlashAttention Issue: Initially, I faced a problem related to FlashAttenti…