lupantech MathVista issues

lupantech / MathVista

MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts

https://mathvista.github.io/

Creative Commons Attribution Share Alike 4.0 International

195 stars 28 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Questions about GPT-4O score on MathVista?

#27 Luodian opened 1 month ago
1
Update calculate_score.py

#26 eltociear opened 1 month ago
0
How can I evaluate MathVista on llava-7b?

#25 QAQdev closed 3 months ago
0
Syntax Correction Needed in README for Unzipping and Removing Command

#24 Aboriginer closed 3 months ago
1
Gemini and GPT4V output file

#23 ggg0919 closed 3 months ago
3
Add .devcontainer, update GPT to use OpenAI >1.x, make Claude and Bard imports dynamics and optional, use HuggingFace datasets

#22 mattmazzola opened 3 months ago
0
How to apply for a leaderboard test

#21 zRzRzRzRzRzRzR closed 4 months ago
1
Return None when str coercion fails or when empty

#20 mattmazzola opened 4 months ago
0
Possible Bug in calculate_score.py, empty responses or extractions results in non-empty normalized extraction due to `get_most_similar`

#19 mattmazzola opened 4 months ago
0
What was the intention of `image_path` in the model files such as gpt.py?

#18 mattmazzola opened 4 months ago
0
Inefficient file write operations - writing entire results dictionary to output path in loops

#17 mattmazzola opened 4 months ago
0
Redundant implementations of `get_chat_response`

#16 mattmazzola opened 4 months ago
0
Extract `pid` from problem in extract_answer.py

#15 mattmazzola closed 4 months ago
1
extract_answer.py - When exception occurs in `extract_answer` function, pid referenced in exception handler, but is not defined

#14 mattmazzola closed 4 months ago
0
How to use generate_responses.py? (References non-existing utilities module)

#13 mattmazzola closed 4 months ago
1
Wrong answer to problems

#12 WesleyHsieh0806 closed 4 months ago
1
Update README.md

#11 pitmonticone closed 4 months ago
0
About source data

#10 steven640pixel closed 5 months ago
1
GPT4V output file

#9 TobiasLee closed 5 months ago
2
Ordering of hint_text and other text when constructing the query

#8 MikeWangWZHL closed 7 months ago
1
Problem 479: Incorrect answer to a problem

#7 mbchang closed 6 months ago
1
Problem 699 (among others): Ambiguous problem about age gap

#6 mbchang closed 6 months ago
1
Problems 107 and 663 (among others): Duplicated question that does actually not test math ability

#5 mbchang closed 6 months ago
1
Problem 781: Ambiguous Problem

#4 mbchang closed 6 months ago
1
Problem 791: Malformed problem

#3 mbchang closed 6 months ago
1
Problem 272: Mismatch between answer choices in the problem and answer choices in the query

#2 mbchang closed 6 months ago
1
Reference Part

#1 tonysy closed 8 months ago
1