search

TRI-ML / prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)
MIT License
425 stars 194 forks source link

evaluatio scripts #5

Closed TobiasLee closed 7 months ago

TobiasLee commented 7 months ago

Hi, thanks for your great work. Is there any plan to release the evaluation scripts for the results reported in the radar plot?

siddk commented 7 months ago

Yes - all evaluation code is in the evaluation repository: https://github.com/TRI-ML/vlm-evaluation

The repo has scripts for automating all the dataset downloads, and evaluating any of the Prismatic models