-
Hello,
Thank you for your excellent work in the multi-modal alignment area!
I’m currently trying to reproduce the results of LLaVA 1.5 7B as reported in your paper and have a few questions regar…
-
Hello, thanks for your wonderful work.
I find lines 306 - 315 in rlaif-v/muffin/eval/muffin_inference_logp.py may cause an error: UnboundLocalError: local variable 'df' referenced before assignment.
…
-
根据readme.md,进行训练只需运行./script/train/llava15_train.sh,但我根据参数和阅读的代码,无法找到有关于论文中 [算法1:Iterative alignment of RLAIF-V] 的相关代码的实现(可能是我漏看了),按我阅读论文的理解,是否要交替运行 data_generation 和 train 各4次(即4次迭代),才能完成完整的复现论文呢?还是我…
-
首先,非常感谢SWIFT带来的便利应用!
我在使用自己lora SFT并merge之后的模型进行dpo训练,完全按照rlhf数据格式创建自己的数据集,但在collate_fn会报错如下:
Map: 100%|██████████████████████████████████████████████████████████████████████████████████████████…
-
Hi,
We have recently released our latest work, `RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness`, on [GitHub](https://github.com/RLHF-V/RLAIF-V) and [arXiv…
-
How did you proceed with DPO learning?
Using CPMTrainer, or HF DPOTrainer?
Does CPM Trainer support DPO finetuning?
-
When I set up just the `dataset_num_proc=2` process in `DPOTrainer`, it seemed to completely pause the step of initializing the trainer map dataset, even though my dataset only had two data points and…
-
Thanks for your wonderful work.
When I tried to load the dataset, an error occurred. However, the data extracting process goes well.
How to fix it?
OSError: Cannot find data file.
Original erro…
-
It looks like llama.cpp now [supports openbmb/MiniCPM-Llama3-V-2_5.](https://github.com/ggerganov/llama.cpp/pull/7599)
Here's the [official gguf.](https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_…
-
When creating a PEFT model and then trying to train it, we get an error;
```
File "/scratch/gpfs/ashwinee/unsloth/unsloth/kernels/fast_lora.py", line 106, in backward
d_do…