search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
782 stars 208 forks source link

installation issue with pip install git+https://github.com/bigcode-project/bigcode-evaluation-harness.git #117

Closed changwangss closed 1 year ago

changwangss commented 1 year ago

Hi, I would like to install with the following method, but it doesn't work.

pip install git+https://github.com/bigcode-project/bigcode-evaluation-harness.git

I get the error

(ipex_latest) [changwa1@aia-sdp-spr-117706 ~]$ python
Python 3.8.13 (default, Mar 28 2022, 11:38:47)
[GCC 7.5.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from  lm_eval import tasks
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'tasks' from 'lm_eval'

the root cause is setup.py file only write the packages=["lm_eval"] folder. there is no tasks folder in my env site-packages folder, so it doesn't find.

(ipex_latest) [changwa1@aia-sdp-spr-117706 bigcode-evaluation-harness]$ cd /home/changwa1/anaconda3/envs/ipex_latest/lib/python3.8/site-packages/lm_eval/
(ipex_latest) [changwa1@aia-sdp-spr-117706 lm_eval]$ ls
arguments.py  base.py  evaluator.py  generation.py  __init__.py  __pycache__   utils.py

code issue is here.

setup(
    description="A framework for the evaluation of autoregressive code generation language models.",
    long_description=readme,
    license="Apache 2.0",
    packages=["lm_eval"],
    install_requires=requirements,
    extras_require={"ds1000": ds1000_requirements},
)

the fixed PR, please review and give comments. PR #116

changwangss commented 1 year ago

@loubnabnl @arjunguha could you please help review? Thanks.

loubnabnl commented 1 year ago

Fixed in the mentioned PR, thanks!