search

locuslab / wanda

A simple and effective LLM pruning approach.
https://arxiv.org/abs/2306.11695
MIT License
676 stars 92 forks source link

How to use sparseGPT to prune the output dimension? #15

Closed wfan1203 closed 1 year ago

wfan1203 commented 1 year ago

How to use sparseGPT to prune the output dimension? When I was calculating the Hessian matrix, the input dimension did not match the Hessian matrix dimension

Eric-mingjie commented 1 year ago

Could you specify what do you mean by "pruning the output dimension"?

wfan1203 commented 1 year ago

感谢您的来信，我将及时回复您！                                                   ——武凡

wfan1203 commented 1 year ago

感谢您的来信，我将及时回复您！                                                   ——武凡