search

titu1994 / keras-one-cycle

Implementation of One-Cycle Learning rate policy (adapted from Fast.ai lib)
MIT License
285 stars 78 forks source link

Do I need weight decay? #19

Open hollowgalaxy opened 5 years ago

hollowgalaxy commented 5 years ago

My model isn't using any regularizers. Do I need weight decay? Or Should add l2? (Model in questions is a mix of 3d convolutions and 2d convolutions)