huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
851 stars 100 forks source link

Data Loading Issues in Offline Mode #270

Closed shahad2099 closed 3 months ago

shahad2099 commented 3 months ago

Hello,

I am currently trying to run an evaluation in offline mode, but I'm encountering issues due to the lack of internet access, which prevents me from using Hugging Face repositories. I've attempted a few solutions, but none have worked so far. I'm specifically struggling with data loading and need to specify the data path manually instead of relying on the Hugging Face repo.

Could someone guide me on how to properly load the data by specifying a local path?

Your assistance would be greatly appreciated.

Thank you.

NathanHB commented 3 months ago

Hi ! If you downloaded the dataset before then you should be able to-redownload in offline mode see here What dataset are you trying to load ?

shahad2099 commented 3 months ago

problem solved , Thank you!

ankit-mh commented 1 week ago

@shahad2099 Can you mention in the comments how you solved the problem?