-
Thanks for the ingenious research work, but I get stuck when I want to replicate your work. I followed the tips in README, I use a conda environment with `transformers=4.37.2`, `lmms-eval=0.2.3.dev0`…
-
I am training task lora on "liuhaotian/llava-v1.5-13b" by following the same code in LLaVA repo:
https://github.com/haotian-liu/LLaVA/blob/main/scripts/v1_5/finetune_task_lora.sh
The above runs fi…
-
### 🐛 Describe the bug
I attempted to train LLaVA (base LLM = LLaMA 3) using the Liger kernel. The loss graph was similar to when I trained LLaVA without the Liger kernel. However, the model traine…
y-rok updated
2 weeks ago
-
Facing the error below while evaluating on the docVQA dataset.
```
Traceback (most recent call last):
File "/scratch/home/gos2pi/miniconda3/envs/llava/lib/python3.10/site-packages/lmms_eval/_…
-
### System Info
container built on 24th of october:
including
pip install tqdm
pip install torch
pip install torchvision
pip install transformers
pip install deepspeed==0.15.2
pip…
-
### Feature request
Hello! It would be awesome to have LLaVa support (upload an image to the API and have it embed it via CLIP etc)
https://github.com/haotian-liu/LLaVA
text-generation-webui alre…
-
When I tried to run the code [here](https://github.com/LLaVA-VL/LLaVA-NeXT/blob/main/docs/LLaVA-NeXT.md), I encountered the following problem:
```
Traceback (most recent call last):
File "/home…
-
Thanks for your awesome work!
After I configured the environment according to the warehouse, I ran the scripts about clipdino336:
```accelerate launch --num_processes=1 -m lmms_eval --model llava …
-
### The model to consider.
**7B Model**: https://huggingface.co/neulab/Pangea-7B
### The closest model vllm already supports.
Pangea and Llava-Next have the same architecture.
https://github.com…
-
num_image_tokens = self.processor._get_number_of_features(orig_height, orig_width, height, width)
I got this error and it pointed to this line of code in the 'llava_next_video' collator.py, it seem…