huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
https://huggingface.co/docs/evaluate
Apache License 2.0
1.9k stars 235 forks source link

Module 'glue' doesn't exist on the Hugging Face Hub either. #574

Closed enori closed 3 months ago

enori commented 3 months ago

I am a beginner at Hugging Face.

I am trying to run "huggingface/accelerate/examples/nlp_example.py", and this error happened. What should I do to solve this error?

$ python accelerate/examples/nlp_example.py 
Traceback (most recent call last):
  File "/home/ubuntu/huggingface/accelerate/examples/nlp_example.py", line 208, in <module>
    main()
  File "/home/ubuntu/huggingface/accelerate/examples/nlp_example.py", line 204, in main
    training_function(config, args)
  File "/home/ubuntu/huggingface/accelerate/examples/nlp_example.py", line 122, in training_function
    metric = evaluate.load("glue", "mrpc")
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/miniconda3/envs/ray_tutorial/lib/python3.11/site-packages/evaluate/loading.py", line 748, in load
    evaluation_module = evaluation_module_factory(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/miniconda3/envs/ray_tutorial/lib/python3.11/site-packages/evaluate/loading.py", line 681, in evaluation_module_factory
    raise FileNotFoundError(
FileNotFoundError: Couldn't find a module script at /home/ubuntu/huggingface/glue/glue.py. Module 'glue' doesn't exist on the Hugging Face Hub either.

(When I asked this issue at accelerate repository, they told me that this issue is related to this repository. here) I apologize if there was already a similar issue. Thanks for your help and kindness!!

enori commented 3 months ago

I was able to solve it on my own. I will share what I did for reference.

I apologize for the inconvenience and appreciate your help.