luuyin / OWL

Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
https://arxiv.org/pdf/2310.05175.pdf
MIT License
51 stars 8 forks source link

Fine-tuning Performance. #6

Open balalofernandez opened 8 months ago

balalofernandez commented 8 months ago

Hi, I cannot locate the fine-tuning part, mentioned in the paper, in your code. Would it be possible to upload it?