search

curegit / deep-descreen

Neural network-based descreening filter for scanned Anime pictures
GNU Affero General Public License v3.0
1 stars 0 forks source link

[開発メモ] 活性化関数 #10

Closed curegit closed 6 months ago

curegit commented 6 months ago

GELU vs ReLU vs Leaky ReLU

Leaky ReLU はナシ。ReLU のほうがシャープ。 GELU と ReLU は少しの差だが、ReLU のほうが高品質。