Vit in proj weight sparsity

calgaryml / condensed-sparsity

[ICLR 2024] Dynamic Sparse Training with Structured Sparsity

https://openreview.net/forum?id=kOBkxFRKTA

MIT License

17 stars 3 forks source link

Closed mklasby closed 1 year ago

mklasby commented 1 year ago

Various additional experiments with sparsifying different ViT components and improvements to code base in general