RLHF-V RLAIF-V issues - Githubissues

RLHF-V / RLAIF-V

RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness

210 stars 6 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Inconsistent Training Parameters in 'trainer_state' and Reproduction Issues

#27 Molly-3000 opened 3 weeks ago
0
vision_tower seem not load

#26 zhangzef opened 3 weeks ago
0
the actual number of samples of the huggingface RLAIF-V-Dataset is 83k, not 30k?

#25 Molly-3000 closed 1 month ago
2
about the RefoMB evaluation experiment

#24 Molly-3000 opened 1 month ago
0
请问一下Iterative alignment是如何在代码中实现的呢？

#23 HeLeHanPrivate closed 1 month ago
1
batch size=1 , only a Nvidia a100 memory=80, why display cuda out of memory?

#22 AderonHuang opened 1 month ago
5
Would the data generation code be released?

#21 Gaffey closed 1 month ago
1
When I use the cal_logp of all dataset,I met the question.This

#20 XiaoLei2123 closed 1 month ago
4
About optimizer setting in Iterative Alignment

#19 davidluciolu closed 1 month ago
2
divide and conquer

#18 dreaming12580 closed 1 month ago
1
Performance of POPE?

#17 shufangxun closed 1 month ago
1
我想问下数据中logps怎么来的

#16 Spring24ch closed 1 month ago
3
Questions Regarding the Training Data and Settings for LLaVA as Used in the Paper

#15 Timsty1 closed 1 month ago
4
UnboundLocalError: local variable 'df' referenced before assignment

#14 Xuchen-Li closed 1 month ago
2
Error when loading datasets split

#13 Xuchen-Li closed 2 months ago
1
请问下divide的模型是额外finetune过的么？

#12 menglin0320 closed 2 months ago
1
The LoRA training codes and scripts

#11 darkpromise98 opened 3 months ago
1
control the output threshold of a large model

#10 zfr00 closed 2 months ago
1
您好，我在跑训练的时候遇见了一个维度错误，不知道如何解决，我使用的是下载的数据集，clip是指定连接下载的clip

#9 XiaoLei2123 closed 1 month ago
3
Hello,when I run the train-scripts,I met the dimension error.But

#8 XiaoLei2123 closed 3 months ago
0
keyerror:idx,I have changed the data_dir,but when I run the train script,I occured the error.How to fix

#7 XiaoLei2123 closed 3 months ago
2
Self feedback data generation pipeline & reference model

#6 charismaticchiu closed 3 months ago
7
Error loading the parquet dataset

#5 charismaticchiu closed 3 months ago
3
Data file not normal when opening "obj_halbench_300_with_image.jsonl"

#4 hxhcreate closed 4 months ago
2
dpo_preference_processor not defined

#3 RifleZhang closed 4 months ago
1
Is there a paper or tech report to show the details of training and dataset

#2 CrossLee1 closed 3 months ago
3
ref_win_logp

#1 buptlihang closed 4 months ago
2