search

Victorwz / VaLM

VaLM: Visually-augmented Language Modeling. ICLR 2023.
https://openreview.net/forum?id=8IN-qLkl215
55 stars 3 forks source link

Evaluation prompts #6

Open paulaonta opened 6 months ago

paulaonta commented 6 months ago

Hello! I'm trying to replicate your model, and while evaluating the model, I noticed that the prompts don't match those in the paper. Are these the final scripts? Thank you

Victorwz commented 6 months ago

Hi, one of the 9 prompts for color reasoning in code is different from the paper appendix. I will update the paper accordingly. Please use the prompts in evaluation_scripts/verify_color_prediction.py