search

mbzuai-nlp / bactrian-x

A Multilingual Replicable Instruction-Following Model
92 stars 3 forks source link

Code for testing your models for Non-English language #1

Open MSamiee opened 11 months ago

MSamiee commented 11 months ago

is there any straightforward code to test your models for Non-English language?

haonan-li commented 9 months ago

We use lm-eval-harness framework to evaluate our model, most of the datasets mentioned in our paper are included in the repo.