PKU-YuanGroup Video-LLaVA issues

PKU-YuanGroup / Video-LLaVA

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

https://arxiv.org/pdf/2311.10122.pdf

Apache License 2.0

3.03k stars 220 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Some weights of the model checkpoint at "./Video-LLaVA-7B" were not used when initializing LlavaLlamaForCausalLM:

#153 ssuncheol opened 6 months ago
0
Size mismatch error when running locally.

#152 ssuncheol closed 6 months ago
3
Problem about pretrain parameter dim size is differen to the model dim size?

#151 NEC09818 opened 6 months ago
1
how to load pretrained weight on local (offline)?

#150 jusepv opened 6 months ago
0
Warnings about weights, temperature, top_p, and embedding layer, but it still works. Should I worry about them?

#149 secretlycarl opened 7 months ago
0
Impossible to install on windows

#148 secretlycarl opened 7 months ago
0
add-llama3

#147 Namzakku closed 7 months ago
0
推理多张图片时报错 IndexError: list index out of range

#146 Qinger27 opened 7 months ago
1
Multi-GPU inference enabled following LLaVA repo

#145 shouborno opened 7 months ago
0
训练时报错AttributeError: 'DeepSpeedCPUAdam' object has no attribute 'ds_opt_adam'

#144 Qinger27 opened 7 months ago
5
Unable to install flash attn module

#143 anantalp closed 7 months ago
2
Seems it has very limited understanding ability..

#142 advenTure423 opened 7 months ago
0
为什么loss一直为0

#141 xienan0326 opened 7 months ago
0
About contrastive learning

#140 mjkmain opened 8 months ago
0
About the license

#139 Pickpate opened 8 months ago
0
Similarity index and time - codes

#138 Tortoise17 opened 8 months ago
0
Tendency to keep repeating the same sentence

#137 pratikkayal opened 8 months ago
2
image / video with different MLPs

#136 wangziyizy opened 8 months ago
0
Unable inference video locally.

#135 Tiancheng-htc opened 8 months ago
1
Gradio APP upgrade

#134 Kamakshi8104 opened 8 months ago
0
How should I obtain llava_image_tune_.json, videochatgpt_tune_.json, and nlp_tune.json

#133 laurenlong opened 8 months ago
5
Reproducibility. Can't install the project `pip install -e .`

#132 felmoreno1726 opened 8 months ago
0
Error when loading released model on huggingface

#131 Leo-Yuyang opened 8 months ago
0
How should I obtain llava_image_tune_.json, videochatgpt_tune_.json, and nlp_tune.json

#130 Annie1900 closed 8 months ago
1
More robust- retries & concurrent inputs

#129 bschreck opened 8 months ago
0
ImportError: dlopen: cannot load any more object with static TLS

#128 digdigdigging opened 8 months ago
0
finetune with lora

#127 cm-xcju opened 8 months ago
14
We couldn't connect to 'https://huggingface.co' to load this file

#126 HolyDragon57 closed 8 months ago
1
Tokenizer in different code version

#125 countytown closed 5 months ago
0
Is there any way to speed up the inference

#124 Coronal-Halo opened 8 months ago
4
How to increase frame from 8 to a bigger number

#123 tarunmis opened 8 months ago
10
How to set the config to use multi node and multi GPUS?

#122 unira-zwj opened 9 months ago
1
RuntimeError : Error(s) in loading state_dict for LlavaLlamaForCausalLM

#121 zhangye0402 opened 9 months ago
2
解码器设置为opencv时，某些视频在推理时出现异常

#120 Chenjm08 opened 9 months ago
0
Transformer version

#119 apurvgandhwani opened 9 months ago
1
Huggingface data files - corrupted zip files?

#118 henryyuanheng-wang opened 9 months ago
2
推理过程中出现错误

#117 zhangye0402 closed 9 months ago
3
Invalid link to MoE-LLaVA

#116 DDVD233 closed 9 months ago
2
Parameter Explanations

#115 Davidyao99 opened 9 months ago
2
video eval error

#114 wsxwd closed 9 months ago
4
huggingface demo is broken

#113 XuankeShi closed 9 months ago
1
Error while loading finetuned model for inferencing.

#112 tarunmis opened 9 months ago
2
What is the minimum gpu ram required for the video model to run?

#111 SarveshAtawane opened 9 months ago
1
How to limit the generated text token to a maximum of 77?

#110 song-wensong opened 9 months ago
1
"RuntimeError: CUDA error: device-side assert triggered"

#109 tarunmis opened 9 months ago
6
Inference on more than 8 frames

#108 Nihel01 opened 9 months ago
2
when training new model, I got stuck in the middle of the training

#107 sunwhw opened 9 months ago
3
Error while feeding the filter graph

#106 Chenjm08 opened 9 months ago
1
推理 GPU bug

#105 827648313 opened 9 months ago
2
断言错误问题

#104 Alexisxty opened 9 months ago
1

Previous Next