luuyin / OWL

Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
https://arxiv.org/pdf/2310.05175.pdf
MIT License
51 stars 8 forks source link

lm_eval missing #4

Closed prashantbhat-tomtom closed 5 months ago

prashantbhat-tomtom commented 10 months ago

I believe the lm_eval file is missing for zero_shot_benchmark. Could you please update?

Thanks in advance

luuyin commented 10 months ago

Hi, you just need to pip install lm-eval