BVLC / caffe

Caffe: a fast open framework for deep learning.
http://caffe.berkeleyvision.org/
Other
34.09k stars 18.7k forks source link

Modify individual learning rates for each neuron. #6779

Open MBasarte opened 5 years ago

MBasarte commented 5 years ago

I'm trying to develop an idea that needs to be able to modify the learning rate of each neuron depending on how much does the neuron activates through the dataset.

Is there any way to change the learning rate of each neuron individually?

Thank you for your time.