showlab / Awesome-MLLM-Hallucination

📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).
389 stars 10 forks source link

Update RLAIF-V #4

Closed yiranyyu closed 3 months ago

yiranyyu commented 4 months ago

Hi,

We have recently released our latest work, RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness, on GitHub and arXiv..

The dataset was on HuggingFace Trending Top 2. We would be truly grateful if you could consider adding RLAIF-V to your collection.

Thank you for your support!

TobiasLee commented 4 months ago

Awesome job, RLAIF-V team @yiranyyu !

I would like to kindly ask if our Silkie (mentioned in the survey paper as reference [68] but not included in the repo) could be added to the list.

You can find the Silkie project page here, which includes the dataset, model weights, and code.

Additionally, we recently discovered a repository for performing RLHF with LMMs to reduce hallucinations: VL-RLHF, might be useful for people interested in this topic.

Thank you!

JosephPai commented 3 months ago

Hi @yiranyyu @TobiasLee , thanks for the reminder. These two papers have been added to the paper list. Btw, the project page of Silkie is broken.

TobiasLee commented 3 months ago

Thanks for your timely efforts! Awesome project again!

The URL https://vlf-silkie.github.io/ is good to me. It's a GitHub Page so you might encounter network proxy issues?