ScandEval / ScandEval

Evaluation of language models on mono- or multilingual tasks.
https://scandeval.com
MIT License
71 stars 13 forks source link

[MODEL EVALUATION REQUEST] MaLA-LM/emma-500-llama2-7b #534

Open KennethEnevoldsen opened 2 weeks ago

KennethEnevoldsen commented 2 weeks ago

Model ID

MaLA-LM/emma-500-llama2-7b

Model type

Decoder model (e.g., GPT)

Model languages

Merged model

Not a merged model

KasperGroesLudvigsen commented 23 hours ago

@saattrupdan are you going to run this? Otherwise I can do it ..

saattrupdan commented 21 hours ago

@KasperGroesLudvigsen Connelly running it yep - thanks though 🙂