Open nishnik opened 5 years ago
Reference:
Absolute value rectification: g(z) =|z|. It is used for object recognition from images (Jarrett et al., 2009), where it makes sense to seek features that are invariant under a polarity reversal of the input illumination.
More about Maxout: statsexchange
6.2.2.4 Other Output Types
Reference:
6.3 Hidden Units
Absolute value rectification: g(z) =|z|. It is used for object recognition from images (Jarrett et al., 2009), where it makes sense to seek features that are invariant under a polarity reversal of the input illumination.
More about Maxout: statsexchange
6.4.1 Universal Approximation Properties and Depth
6.5.5 Symbol-to-Symbol Derivatives