search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
710 stars 183 forks source link

ModuleNotFoundError: No module named 'lm_eval.ds' #129

Closed dhingratul closed 10 months ago

dhingratul commented 10 months ago

from .ds.ds1000 import DS1000Dataset

*** ModuleNotFoundError: No module named 'lm_eval.ds'

loubnabnl commented 10 months ago

Hi, could give more details on the command you're trying to run with the full stack trace. Also did you follow all the DS100 installation instructions here it has more requirements that the other tasks (it could also be that you have a module named lm_eval from another library like the LLM harness so they are getting confused I would suggest having a separate environement)

dhingratul commented 10 months ago

This is solved, i was working in an offline manner, and had to manage the DS1000 dependencies correctly.