search

titu1994 / tf_SIREN

Tensorflow 2.0 implementation of Sinusodial Representation networks (SIREN)
MIT License
149 stars 26 forks source link

Why Sine activation function as a network layer in use? #3

Closed ZeHuangFang closed 4 years ago

ZeHuangFang commented 4 years ago

Thank you for your contribution!

I saw in the SinusodialRepresentationDense layer that the Sine activation function was passed as a network layer? Is there any benefit to doing this?

And what happens if I change it to normal function?

Thank you very much!

titu1994 commented 4 years ago

Nothing much happens. You can of course use it directly. Keras custom layers like LeakyRelu are however built for activation functions with arguments - here w0. So I used it as a layer.

ZeHuangFang commented 4 years ago

Yes, it works fine as a normal function! I plan to extend it to RNN's network, for better signal processing. Thanks again!