search

biubug6 / Pytorch_Retinaface

Retinaface get 80.99% in widerface hard val using mobilenet0.25.
MIT License
2.61k stars 767 forks source link

leakyRelu activation fuction? #50

Open Keysmis opened 4 years ago

Keysmis commented 4 years ago

i found your model use leakyRelu activation fuction, the original model uses Relu fuction, is the leakyRelu makes better? thx~~

biubug6 commented 4 years ago

Due to the lack of small network expression ability, leakyRelu can enhance the expression ability of the network. But it also destroys the sparse structure of the network.