locuslab / wanda

A simple and effective LLM pruning approach.
https://arxiv.org/abs/2306.11695
MIT License
564 stars 67 forks source link

Pruning image classification models (mlp_mixer) #39

Open mammadmaheri7 opened 3 months ago

mammadmaheri7 commented 3 months ago

Thank you for your project. I noticed the presence of the mlp_mixer models in the project. I am curious if sparsification has been implemented on this model or on other image classification models.

Eric-mingjie commented 3 months ago

We did not evaluate the mlp_mixer model in our experiments. It was there likely due to inheritance from the repository we are borrowing https://github.com/facebookresearch/dropout.