haotian-liu LLaVA issues

haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

https://llava.hliu.cc

Apache License 2.0

17.8k stars 1.92k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Question] lora fine-tuning inference

#1581 pranavsingapore opened 1 day ago
0
[Question] Mac run but get importlib.metadata.PackageNotFoundError: No package metadata was found for bitsandbytes

#1580 Timothychen00 opened 2 days ago
1
[Usage] Non-deterministic output during inference, occur specifically in the CLIP ViT encoders

#1579 OliverXUZY opened 2 days ago
0
[Question] Why LLaVA-1.5-13b keep repeatting answer in the first round conversation?

#1578 PoopBear1 opened 3 days ago
1
[Question] LLaVA-NeXT-Video 7B with stride=1 Memory Error

#1577 jongwoopark7978 opened 3 days ago
0
[Question] When I added some code like 'print' in train.py and then run 'finetune_task_lora.sh', it would get the same results of the first run.

#1576 riccardohhhhzz opened 3 days ago
0
[Usage] Can't run inference on multiple GPUs

#1575 lingjunzhao opened 3 days ago
0
Smaller llm and/or vision models

#1574 sonic182 opened 3 days ago
0
add qwen2 support for pretraining and finetuning

#1573 TobyYang7 opened 4 days ago
0
Fluffyvision

#1572 W-Jonas closed 4 days ago
0
ModuleNotFoundError: No module named 'llava'

#1571 tanttttt opened 1 week ago
0
[Usage] 7B Inferece CUDA Out of Memory for RTX 4090 24GB VRAM

#1570 0010SS opened 1 week ago
0
Why use plain text sharegpt datasets for instruction tuning

#1569 AshOneN opened 1 week ago
1
"Assertion `srcIndex < srcSelectDimSize` failed" in Docker on some systems

#1568 Careiner opened 1 week ago
1
Having issues while merging LoRA attention weights

#1567 anas-zafar opened 1 week ago
1
[Questions] "non_lora_trainables.bin" has an impact on the model

#1566 supech closed 1 week ago
1
[Question] Question on `image_newline` for single image

#1565 SCZwangxiao opened 1 week ago
0
[Question] What is the accuracy of InstrumentBLIP on VQAv2?

#1564 Cap1tao opened 1 week ago
0
Does the llavaNext 1.5 stage still trained only proj only?

#1563 lucasjinreal opened 1 week ago
0
LLaVA Context-length

#1562 oroojlooy opened 1 week ago
0
[Usage] Missing File in Release LLaVA-v1.6 and RuntimeError in model_vqa_qbench.py

#1561 X1AOX1A opened 1 week ago
2
[Question] Fine-tune only the projector?

#1560 ggcr opened 1 week ago
1
Realtime Image Description

#1559 Bikram9035 opened 2 weeks ago
0
[版本冲突]环境配置要求版本冲突

#1558 l-show opened 2 weeks ago
2
[Question]About Full Parameter Finetune cost ？

#1557 AngelAlita opened 2 weeks ago
0
[Discussion] why are the results on post inconsistent with opencompass?

#1556 geweihgg opened 2 weeks ago
0
[Usage] Not able to fine tune the LLaVA model with llava-v1.5-7b.

#1554 ayushgupta9198 opened 2 weeks ago
3
[Usage] ValueError: The current `device_map` had weights offloaded to the disk.

#1553 Ali-Forootani opened 2 weeks ago
0
[Usage] Merging LoRa weights into llava-13b fails with bizarre error

#1552 maxall41 opened 2 weeks ago
1
[Discussion] Request for Guidance on Stage Two: Converting LLaVA-V1.6 into 4-bit GGUF Format (PAPER)

#1551 rohithbojja opened 3 weeks ago
0
Pip install got an error So, do you install the llava in a new docker?

#1550 xiaxiaxiatengxi opened 3 weeks ago
0
[Question] Is there a way to make llava-v1.6-mistral-7b-hf always return json?

#1549 fangyizhu opened 3 weeks ago
0
[Usage] Llava-Gemma Pretraining + Fine tuning Usage issue and missing Fine tuned projector.bin

#1548 nlpkiddo-2001 opened 3 weeks ago
0
[Question] Evaluate on OKVQA

#1547 FightingFighting opened 3 weeks ago
0
[Question] No matter what I ask, my model always gives the same answer.

#1546 zy1996829 opened 3 weeks ago
2
[Question] Clarification on the Threshold for "Sufficient" Task-Specific Data for Full-Model Finetuning

#1545 YoungjaeDev opened 3 weeks ago
0
How to fine-tune llava-v1.6-mistral-7b on GQA dataset

#1544 qhz991029 opened 3 weeks ago
4
[Usage] Both demo links are down! Would you please check them out?

#1543 NavidRajabi opened 3 weeks ago
1
[Usage] Merging LoRA weights using the script "LLaVA/scripts/merge_lora_weights.py" results in a model size about two times larger than the original Llama2 model.

#1542 supech opened 3 weeks ago
0
[Usage] When running Example Code in colab, CuDA out of memory is reported

#1541 lmcjrrg closed 3 weeks ago
2
[Usage] Error when loading adapter_model.safetensors

#1540 NicoZenith opened 3 weeks ago
2
Nothing

#1539 DemoGit4LIANG closed 1 week ago
0
Batch size to reproduce llava-1.5-7B

#1538 zzxslp opened 3 weeks ago
0
Does vistion tower trained during starge 2 (Visual Instruction Tuning)?

#1537 GoGoJoestar opened 3 weeks ago
2
How to perform cross-validation during the fine-tuning process?[Question]

#1536 J0eky opened 3 weeks ago
0
load_dataset(liuhaotian/LLaVA-Instruct-150K) fails with error, when generating train split: 394276 examples

#1535 kzos opened 3 weeks ago
1
Can we use this model to identify between real and AI generated/fake image?

#1534 gitusersfor opened 4 weeks ago
0
[Question] about the --vision_tower in the scritps

#1533 zihui-debug opened 4 weeks ago
0
Where does the video interpolate indicates in the code?

#1532 lucasjinreal opened 1 month ago
0
Update eval_science_qa.py

#1530 jubinchheda opened 1 month ago
1