search

calgaryml / condensed-sparsity

[ICLR 2024] Dynamic Sparse Training with Structured Sparsity
https://openreview.net/forum?id=kOBkxFRKTA
MIT License
17 stars 3 forks source link

Dynamic ablation #37

Closed mklasby closed 1 year ago

mklasby commented 1 year ago

Added dynamic ablation for neurons with const-fan-in constraint. Parameterized by rigl.min_salient_weights_per_neuron and rigl.dynamic_ablation in config.yaml.