nlp-uoregon mlmm-evaluation issues - Githubissues

nlp-uoregon / mlmm-evaluation

Multilingual Large Language Models Evaluation Benchmark

Apache License 2.0

109 stars 18 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

The leaderboard is broken

#14 constanzafierro opened 3 weeks ago
2
Falcon Multilingual Results

#13 Mugariya opened 3 months ago
0
Few Shot configuration

#12 Nkluge-correa opened 3 months ago
0
Add Azerbaijani(Arabic Script) to languages

#11 Jalilnkh opened 3 months ago
0
Please add support for Adapter Models

#10 1rsh opened 5 months ago
1
feature: evaluate Qwen2-7B on ar_arc dataset

#9 mouhandalkadri opened 5 months ago
0
Need to submit results

#8 Mugariya opened 5 months ago
0
How to use multiple gpu for inference?

#7 SefaZeng opened 5 months ago
0
Doesn't work with any HF model

#6 PovedaAqui opened 6 months ago
1
Not Support English MMLU?

#5 moore3930 opened 6 months ago
0
ollama installed models

#4 PovedaAqui opened 7 months ago
1
feature: evaluate Jais13B on ar_arc dataset

#3 mouhandalkadri opened 7 months ago
0
ARC-Easy Dataset

#2 yaof20 opened 8 months ago
0
Got stuck when evaluating MMLU

#1 zhangliang-04 opened 11 months ago
4