haotian-liu LLaVA issues

haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

https://llava.hliu.cc

Apache License 2.0

20.36k stars 2.25k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Question] Where can I obtain the training dataset of the LLava 1.5?

#1776 weiaicunzai opened 2 days ago
1
[Usage] json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1559608 column 82 (char 39444904)

#1775 tianke0711 opened 4 days ago
0
[Question] Image-text match

#1774 hazardout opened 4 days ago
0
[Usage] The issue encountered when fine-tuning llava_mistral1.6 using LoRA

#1772 yuwang4321 opened 6 days ago
0
[Usage] Infer on model finetuned using finetune_qlora.sh

#1771 amagzari opened 6 days ago
0
[Question] Can not reproduce LLaVA 1.5 performance on ScienceQA

#1770 yiwei-chenn opened 1 week ago
0
Where is convert_answer_to_mme.py?

#1769 Tramac opened 1 week ago
0
[Question] disable print

#1768 LiXinYuann opened 1 week ago
0
[Question] Pretrain preprocess

#1767 leo-young opened 1 week ago
0
[Question] Issue with trying to reproduce the results of LLaVA-Bench-in-the-Wild on LLaVA-v1.5-7b. Has anyone who's reproduced it got this error?

#1766 cookiesupers22 opened 1 week ago
0
[Question] LLaVA 1.5 7B model fine-tune -- pydantic

#1765 yiwei-chenn closed 1 week ago
1
[Usage] Missing file 'model_vqa_qbench'

#1764 eslambakr opened 1 week ago
0
[Usage] Inference Speed Issue with LoRA Fine-tuned Model on ScienceQA

#1763 jinghanSunn opened 1 week ago
0
[Usage] Error during evaluation for image.../image.png: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

#1762 ChathurangiShyalika opened 1 week ago
0
Fine tune for object detection

#1761 ck-amrahd opened 1 week ago
0
[Discussion] pip install e . error

#1760 JavaWebT opened 1 week ago
0
[Usage] Training process get stuck in the last iteration of instruction finetuning phrase.

#1759 fmy7834 opened 2 weeks ago
0
[Question] Is it possible to extract the latent representation of the image input from the model?

#1758 Tizzzzy opened 2 weeks ago
0
[Usage] How to run CLI after Visual Instruction Tuning with lora?

#1757 YUECHE77 closed 2 weeks ago
1
Could you please provide the test files of vqav2 and gqa on llava-15-7b？

#1756 liuting20 opened 3 weeks ago
0
pip install -e . Error

#1755 Sarah-air opened 3 weeks ago
1
Parallel fixes

#1754 lpullela opened 3 weeks ago
0
[Question] Where to get llava_train_QCM-LEPA.json file?

#1753 sean-wade closed 3 weeks ago
1
Inference Issue on Fine-tuned Lora model.

#1752 psvkaushik opened 3 weeks ago
0
[Usage] can not print weight in callback function

#1751 gaojianzhang opened 3 weeks ago
0
[Usage] loss quickly drops to near zero

#1750 gaojianzhang opened 3 weeks ago
0
Invalidate trace cache @ step 4: expected module 458, but got module 466

#1749 waybarrios opened 3 weeks ago
0
[Usage] ValueError

#1748 t-mockbel opened 3 weeks ago
1
[Question] SEED Bench video frame extract

#1747 lyklly opened 4 weeks ago
0
Process Hang on when fine-tuning in multi-GPUs by using zero-3

#1746 zhangsha1024 opened 4 weeks ago
0
[Question] Having an issue using the merge weights script.

#1745 Silverasdf opened 1 month ago
4
[Question] 打开网页后显示：error Could not parse server response: SyntaxError: Unexpected token 'I', "Internal S"... is not valid JSON

#1744 BinTangHuLu closed 1 month ago
2
Eval fixes

#1743 lpullela closed 1 month ago
0
[Question] How to save lora model with fine-tuning parameters?

#1742 cjc20000323 opened 1 month ago
0
[Question] When loading training image data, is it loaded into memory all at once, or is it loaded from disk to memory according to batch_size?

#1741 yangzhipeng1108 opened 1 month ago
0
[Usage] Encountered an issue while installing the environment with 'pip install flash-attn --no-build-isolation“

#1740 freya-7 opened 1 month ago
1
[Question] How can I create optimizer.pt file for the checkpoint when I finetune the model?

#1739 Bleking closed 3 weeks ago
2
[Question] Question about `--image_aspect_ratio pad`

#1738 OedoSoldier opened 1 month ago
0
[Question] Not able to load https://huggingface.co/liuhaotian/llava-lcs558k-scienceqa-vicuna-13b-v1.3 into google colab. Please help 🙏🙏

#1737 cookiesupers22 closed 1 week ago
2
feature_img_folder_None

#1736 pegah-kh opened 1 month ago
0
[Usage] 。。。

#1735 haiduo closed 1 month ago
0
[Usage] Not able to save model weights after Lora Finetuning

#1734 narayanasastry-rvds opened 1 month ago
4
[Question] Which phase should we submit to evaluate the VisWiz in the paper?

#1733 WeitaiKang opened 1 month ago
3
[Question] Which code is the Loss of the llava model? I didn't find it?

#1732 Humble2967738843 opened 1 month ago
1
Caught ValueError: Unable to create tensor, you should probably activate padding with 'padding=True' to have batched tensors with the same length.

#1731 Netceor opened 1 month ago
0
[Question] Now I hope to take the pre-trained multimodal model and use the instruction fine-tuning method to adapt to the new data set of downstream tasks. However, the types of these data sets include: pure text mode and image text. Is there no way to fine-tune this data set with only text mode? (Or is it possible to fine-tune the language model in the multimodal model independently? [in a daze])

#1730 Humble2967738843 opened 1 month ago
0
[Usage] Getting "The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them" error

#1728 enpro-github opened 1 month ago
0
Clean code

#1727 lpullela closed 1 month ago
0
[Question] How can I use the CLI after running the fine-tuning script?

#1726 Silverasdf closed 1 month ago
3
[Usage] ValueError: Unrecognized configuration class <class 'transformers.models.llava.configuration_llava.LlavaConfig'> for this kind of AutoModel: AutoModelForCausalLM.

#1725 Lareina2441 closed 1 month ago
3