-
In this issue, it is said that related code would be released at https://github.com/RLHF-V/RLAIF-V/issues/6, but I find this [link](https://github.com/RLHF-V/RLAIF-V#data-generation) is empty. Where c…
-
frame #6: c10d::ProcessGroupNCCL::ncclCommWatchdog() + 0x10c (0x7f3f32cae6fc in /opt/conda/envs/vrm/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #7: + 0xd3e95 (0x7f40271b5e95 in /o…
-
Hello,
Thank you for your excellent work in the multi-modal alignment area!
I’m currently trying to reproduce the results of LLaVA 1.5 7B as reported in your paper and have a few questions regar…
-
### Feature request
https://github.com/CarperAI/trlx
### Motivation
https://twitter.com/i/web/status/1668337702440165376
RLAIF-V effectively reduce the hallucination of different MLLMs
**Paste any useful information**
Paste any useful…
-
首先恭喜获得best paper！！！
我这面有个疑问，我想试验一下论文中label smooth这块，但是在代码中没有发现有关label smooth的损失修改，另外也没有发现任何关于损失添加margin的代码，请问这块是没有release出来吗？
-
-
### System Info
- `transformers` version: 4.41.2
- Platform: Linux-5.10.0-1.0.0.28-x86_64-with-glibc2.31
- Python version: 3.10.14
- Huggingface_hub version: 0.24.6
- Safetensors version: 0.4.4…
-
Hi, can you provide the steps, settings and dataset that can be used to replicate the results of Lotto method given in Table 3 and 4? Is the instruction following dataset among `https://huggingface.c…
-
Hello, thanks for your wonderful work.
I find lines 306 - 315 in rlaif-v/muffin/eval/muffin_inference_logp.py may cause an error: UnboundLocalError: local variable 'df' referenced before assignment.
…