terkkila / cgml

Machine Learning with Computational Graphs
Apache License 2.0
2 stars 0 forks source link

Costs and activation functions for Saturating Autoencoder #26

Open terkkila opened 10 years ago

terkkila commented 10 years ago

Interesting article talking about Saturating Autoencoders, or SATAEs: http://arxiv.org/pdf/1301.3577.pdf

SATAE would provide an alternative to contracting Autoencoder that has the bottleneck layer to prevent learning the trivial identity transformation.