search

kaistAI / LangBridge

[ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
https://aclanthology.org/2024.acl-long.405/
69 stars 7 forks source link

Question about evaluating the model #8

Closed Mangoho closed 1 month ago

Mangoho commented 4 months ago

Hi, I am trying to run eval/metamath-lb-9b.sh, but I can't find the package to import: from lm_eval import tasks, evaluator, utils from lm_eval.models.langbridge import LBSeq2SeqLM can you please provide the code or package version?

MattYoon commented 3 months ago

Hi, @Mangoho .

Did you run 

pip install -e .
pip install -e bigcode-evaluation-harness
pip install -e evaluation-harness

in your environment?