Pokemon-Huang / sparse-structure-selection-PyTorch

PyTorch-Implementation of "Data-Driven Sparse Structure Selection for Deep Neural Networks"
20 stars 2 forks source link

Work with Adam? #3

Open YilinLiu97 opened 2 years ago

YilinLiu97 commented 2 years ago

Thank you for your work! I'm wondering if this algorithm also works for Adam?

Pokemon-Huang commented 2 years ago

Sry i did not try adam, but i dont think the l1 loss in sss and adam are in conflict.