PKU-YuanGroup Chat-UniVi issues

PKU-YuanGroup / Chat-UniVi

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

https://arxiv.org/abs/2311.08046

Apache License 2.0

751 stars 41 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#56 xlxxcc closed 2 weeks ago
2
The image folder in the MIMIC_Imageonly

#55 SitongGong closed 1 month ago
0
Can this model apply a few-shot when inference?

#54 Ijustakid opened 1 month ago
0
mm_projector.bin | size mismatch error

#53 Asma-Alkhaldi opened 1 month ago
0
Hosting ChatUniVi in Sanic Application: ZeroDivisionError

#52 ervinweelzwork opened 1 month ago
0
Why `image_aspect_ratio` is set to `square` rather than `pad`

#51 linhaojia13 closed 1 month ago
1
Downloading the ActivityNet (Zero Shot) Dataset

#50 Backdrop9019 closed 2 months ago
3
ModuleNotFoundError: No module named 'ChatUniVi.model.language_model.phi'

#49 guzixian opened 2 months ago
3
Is it a mistake to get patch_num_h from w?

#48 21makunyang closed 2 months ago
1
huggingface demo error

#47 wenjiajia123 opened 2 months ago
0
Unable to Reproduce Training Process

#46 Toneyaya closed 2 months ago
3
【Bug】Training becomes pending if the training dataset contains text data.

#45 lg123666 closed 2 months ago
1
inference

#44 JHChen1 closed 3 months ago
0
Hardware requirements for inference

#43 JHChen1 closed 3 months ago
0
A bug of the latest commit ` add v1.5`

#42 linhaojia13 closed 3 months ago
2
Could you release the trained weights of the Stage-1 Training?

#41 linhaojia13 closed 3 months ago
2
dpc implementation

#40 ReactiveCJ opened 3 months ago
1
When will the training codes and model weights of `Chat-UniVi-7B v1.5` be released?

#39 linhaojia13 closed 3 months ago
2
Where is `CGD/images`, `LA/images` and `SD/images`?

#38 linhaojia13 closed 3 months ago
1
16GB-VRAM run Chat-UniVi-7B-v1.5 model？

#37 joseph16388 opened 3 months ago
1
Question about how to detect events in video

#36 xiaokj37 opened 4 months ago
2
Question about llama_flash_attn_monkey_patch

#35 mmmwhy closed 3 months ago
1
repalce Vicuna-7B with meta-llama/Meta-Llama-3-8B-Instruct

#34 mmmwhy closed 4 months ago
3
422 Unprocessable Entity

#33 aliayub40995 opened 4 months ago
1
Inference Time Issue

#32 HYUNJS closed 4 months ago
2
Question about TCBlock

#31 HYUNJS closed 4 months ago
2
Failed to run main_demo_13B.py

#30 wegigabyteinsn closed 5 months ago
3
v1.5 weights release plan

#29 HYUNJS closed 5 months ago
2
Failed to run main_demo_7B.py

#28 wegigabyteinsn closed 5 months ago
1
Question regarding the evaluation of video understanding

#27 cv-learner closed 5 months ago
2
Visualisation code for temporal clustering

#26 shehanmunasinghe closed 5 months ago
1
about temporal merging

#25 xxtars closed 5 months ago
1
huggingface demo is broken

#24 XuankeShi closed 6 months ago
1
runtime error on huggingface space

#23 verigle closed 6 months ago
1
Can you provide a pre-trained loss curve chart，and sft loss curve chart

#22 feiyilicare closed 6 months ago
3
Any plans to implement within HF Transformers?

#21 athewsey closed 5 months ago
1
encounter a problem when initialize Chat-UniVi-13B with downloading weights file

#20 shihuai closed 7 months ago
2
What's the minimal device requirement on this project?

#19 leeaction opened 7 months ago
4
KeyError: 'ChatUniViConfig'

#18 Juice113 closed 8 months ago
3
details on COCO based data for pre-training.

#17 yash0307 closed 8 months ago
2
Questions about training GPU memory

#16 MingfangDeng closed 8 months ago
6
KeyError: 'COCO2017'

#15 MingfangDeng closed 8 months ago
2
clustering impedes gradient backprop to ViT, any consideration?

#14 MarStarck closed 8 months ago
1
TCBlock is useless

#13 MarStarck closed 8 months ago
1
Failed to run main_demo_7B.py

#12 notus126 closed 8 months ago
1
Is the clustering algorithm applied during inference?

#11 notus126 closed 8 months ago
1
runtimeError:Errors in loading state_dict for ChatUniViLlamaForCausalLM

#10 MingfangDeng closed 8 months ago
4
Question regarding GPT scores for video comprehension

#9 yuu2704 closed 5 months ago
2
Any comparison with LLAVA1.5?

#8 fredshentu closed 9 months ago
1
About the visualization

#7 pd162 closed 9 months ago
2