Support hyper parameter for activation layer

nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.

Apache License 2.0

134 stars 71 forks source link

Support hyper parameter for activation layer #2614

Open baek2sm opened 1 month ago

baek2sm commented 1 month ago

Our framework currently does not receive hyperparameters when implementing the activation layer. Because of this, layers that require separate hyperparameter settings such as Leaky ReLU are always implemented to operate with a fixed constant value for now. If technically possible but not applied, we need to update existing activation layers(leaky, selu, and so on).

taos-ci commented 1 month ago

:octocat: cibot: Thank you for posting issue #2614. The person in charge will reply soon.