Closed accosmin closed 5 years ago
Have layers set to random values (e.g. trainable=false) Extend activation layers to have a trainable scalar parameter that smoothly maps from linear to nonlinear transformations.
Have layers set to random values (e.g. trainable=false) Extend activation layers to have a trainable scalar parameter that smoothly maps from linear to nonlinear transformations.