might as well include analysis for GELU in future

digantamisra98 / Mish

Official Repository for "Mish: A Self Regularized Non-Monotonic Neural Activation Function" [BMVC 2020]

MIT License

1.29k stars 130 forks source link

Closed saurabh-kataria closed 5 years ago

saurabh-kataria commented 5 years ago

digantamisra98 commented 5 years ago

@saurabh-kataria Surely will. I am still continually performing more and more benchmarks.