jquesnelle / yarn

YaRN: Efficient Context Window Extension of Large Language Models
MIT License
1.32k stars 115 forks source link

How should I proceed with conducting an evaluation for lm-evaluation-harness? #54

Open yuri-son opened 6 months ago

yuri-son commented 6 months ago

Hello developer, I've been trying to conduct an evaluation of lm-evaluation-harness based on your paper, but I'm encountering an issue stating that the directory doesn't exist.

Could you provide more detailed instructions on how to conduct the evaluation?

Here is the command I've been using and the error that occurs.

command pip install git+https://github.com/EleutherAI/lm-evaluation-harness ./eval-harness.sh

error-command python: can't open file '/workspace/yarn/../lm-evaluation-harness/main.py': [Errno 2] No such file or directory

Your assistance would be greatly appreciated! (help me plz..!!!)