ys-zong / VL-ICL

Code for paper: VL-ICL Bench: The Devil in the Details of Benchmarking Multimodal In-Context Learning
https://ys-zong.github.io/VL-ICL/
29 stars 2 forks source link

Code/templates release for the LLaVA-OneVision model #9

Open agadetsky opened 1 week ago

agadetsky commented 1 week ago

Hi!

Can you release the evaluation code for LLaVA-OneVision to reproduce the results from the paper? Or can you share the templates used for LLaVa-OneVision? Did you use multi-turn conversation with chat templates, i.e., providing few-shot examples as the conversation between user and assistant within the corresponding role headers, or you didn't use chat template?

Thank you and looking forward to your response.