LLaVA-VL LLaVA-NeXT issues

LLaVA-VL / LLaVA-NeXT

Apache License 2.0

2.52k stars 186 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How do we turn off Flash attention in LLaVA-NeXT?

#224 Bleking opened 2 weeks ago
0
Question about llava-ov model and video input

#223 YoungjaeDev opened 2 weeks ago
0
location of llava_1_6.json

#222 starhiking closed 2 weeks ago
1
Query about the dimension of outputs.attentions

#221 sterzhang opened 2 weeks ago
7
Increase in training speed, pip list

#220 mylesgoose opened 3 weeks ago
0
Unable to complete final installation step.

#219 NovaBro opened 3 weeks ago
5
Where can I get the pretrained model for finetuning of LLaVA-NeXT?

#218 Bleking closed 2 weeks ago
36
Release with Llama 3 base?

#217 adrielkuek opened 3 weeks ago
0
Running LLaVA_OneVision_Tutorials.ipynb reports an ValueError: Unknown vision tower: google/siglip-so400m-patch14-384

#216 MXC66ai opened 3 weeks ago
1
Can we have access to LLaVA-NeXT-Video training data? i.e. LLaVA-NeXT-Video-SFT-Data

#215 williamium3000 opened 3 weeks ago
0
question about Temporal QA Set and Instruction Tuning

#214 YoungjaeDev opened 3 weeks ago
0
ValueError: The checkpoint you are trying to load has model type `llava_qwen` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

#213 eternal8080 opened 3 weeks ago
0
preprocess_qwen does not mask labels for <|im_start|> <|im_end|>

#212 halflearned opened 3 weeks ago
0
[Question] A series of questions about fine tuning , I want to learn this stuff

#211 bdv29 opened 3 weeks ago
0
Use the llava-onevision weights as starting point for finetuning on custom dataset

#210 NicoZenith opened 3 weeks ago
1
Cuda failure 'invalid argument'

#209 FSet89 opened 3 weeks ago
7
The 7b model is difficult to reproduce

#208 rookiez7 closed 1 week ago
1
too many version coexists in this repo, messy

#207 dragen1860 opened 3 weeks ago
0
Video Demo Code Messed Up After Recent Commit

#206 varungupta31 closed 3 weeks ago
2
update video inference logic

#205 ZhangYuanhan-AI closed 1 week ago
0
(Community Chatting Group)建一个微信交流群，这样大家有问题可以实时讨论

#204 chmod777john closed 2 weeks ago
1
LoRA Training Script for Model Based on finetune_onevision

#203 YoungjaeDev closed 2 weeks ago
11
performance problem of llava-next-video-34b DPO model

#202 YoungjaeDev opened 4 weeks ago
2
Question about AnyRes usage in LLaVA-NeXT-Video demo

#201 YoungjaeDev closed 3 weeks ago
2
[Question] Is it possible to convert `LlavaMistralForCausalLM` to `LlavaNextForConditionalGeneration`?

#200 kouyakamada opened 4 weeks ago
0
[Common Issues] Releasing LLaVA-OneVision data yaml files in three stages (mid/single-image/onevision)

#199 Luodian opened 4 weeks ago
2
Add safe load tokenizer for llama_3

#198 ngquangtrung57 closed 1 month ago
0
Optimal prompt format for reasoning on various questions.

#197 xin-ran-w opened 1 month ago
1
High Memory Usage in DataLoader Workers Leading to Out-of-Memory (OOM)

#196 inigopm closed 2 weeks ago
4
Fix: videos in LLaVa-OV

#195 zucchini-nlp closed 1 month ago
4
About LLaMA-3-LLaVA-NeXT-8B: The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.

#194 wangtong627 opened 1 month ago
1
Conversion of checkpoints to hf format

#193 NicoZenith opened 1 month ago
0
What does the `trl` folder do?

#192 leexinhao closed 4 weeks ago
1
AttributeError: 'LlavaQwenConfig' object has no attribute 'mm_newline_position'

#191 yhyang123 opened 1 month ago
3
How to access video data in LLaVA-OneVision?

#190 xsgldhy opened 1 month ago
2
Load checkpoint after finetuning

#189 huynhbaobk closed 1 month ago
1
ValueError: Unknown vision tower: google/siglip-so400m-patch14-384

#188 ghost opened 1 month ago
3
Weight shape mismatch

#187 byungokhan closed 1 month ago
8
0.5b model work fine,7b model result is `['']`

#186 rookiez7 closed 1 week ago
3
Evaluation code is missing.

#185 Leon1207 opened 1 month ago
2
LLaVA-NeXT-Video-32B-Qwen gives inaccurate video analysis.

#184 ghost opened 1 month ago
0
update video code

#183 ZhangYuanhan-AI closed 4 weeks ago
3
checkpoint for finetuning / datafile for finetuning

#182 YerongLi closed 3 weeks ago
4
Request for Detailed Parameter Breakdown of LLaVA-NeXT-Interleave 7B Model and VRAM Requirements

#181 YoungjaeDev opened 1 month ago
0
Update LLaVA OneVision model to lmms-lab/llava-onevision-qwen2-7b-ov

#180 Luodian closed 1 month ago
0
(Community Chatting Group)建一个微信交流群，这样大家有问题可以实时讨论

#179 chmod777john closed 3 weeks ago
3
Failure to reproduce the paper results

#178 yuan-QAQ opened 1 month ago
1
Size Mismatch Issue in ‘mm_projector.bin’ for ‘llava-onevision-qwen2-0.5b-ov’ Model

#177 fancy12335 opened 1 month ago
5
Bugs in the inference phase

#176 josephzpng closed 1 month ago
1
resources required for training with 72b language models

#175 annopackage opened 1 month ago
3

Previous Next