Bug with lighteval on running from notebook

mlabonne / llm-autoeval

Automatically evaluate your LLMs in Google Colab

MIT License

460 stars 77 forks source link

Bug with lighteval on running from notebook #23

Closed ann-brown closed 3 months ago

ann-brown commented 3 months ago

At the end of the run, I am getting:

2024-03-25T13:57:22.568287661Z Traceback (most recent call last): 2024-03-25T13:57:22.568325169Z File "/lm-evaluation-harness/../llm-autoeval/main.py", line 7, in 2024-03-25T13:57:22.568330133Z from lighteval.evaluator import make_results_table 2024-03-25T13:57:22.568333613Z ModuleNotFoundError: No module named 'lighteval'

mlabonne commented 3 months ago

Hi @ann-brown. Sorry about that, this is fixed.