Evaluation Framework - Githubissues

punith300i / nlp-vlm-project

CS544 NLP project Team

0 stars 0 forks source link

Evaluation Framework #11

Open zvovov opened 1 year ago

zvovov commented 1 year ago

[ ] Shortlist metrics
[ ] Shortlist datasets - eval scripts available
[ ] Write Evaluation script

zvovov commented 1 year ago

[ ] VLStereoSet: vision + language - Chirag
[ ] MMLU: vision + language - Mihir
[ ] SuperGLUE: vision + language - Lavrenti
[ ] MSCOCO: vision
[ ] More?

zvovov commented 11 months ago

Experiment Log https://docs.google.com/spreadsheets/d/e/2PACX-1vSKaHEd7jwHkZFcMir42plI3l3Cdp_KUJuVbW8gavOKlKJZTIO2daP2odVHxUDZ01Rgrgrw8eUQyIOD/pubhtml