cazala / synaptic

architecture-free neural network library for node.js and the browser
http://caza.la/synaptic
Other
6.91k stars 666 forks source link

How to update the activation function? #216

Closed TheInvoker closed 7 years ago

TheInvoker commented 7 years ago

If I create a network like this

        var learningRate = .3;
        var Layer = synaptic.Layer;
        var Network = synaptic.Network;

        // create the network
        var inputLayer = new Layer(2);
        var hiddenLayer = new Layer(3);
        var hiddenLayer2 = new Layer(3);
        var outputLayer = new Layer(1);
        inputLayer.project(hiddenLayer);
        hiddenLayer.project(hiddenLayer2);
        hiddenLayer2.project(outputLayer);
        var myNetwork = new Network({
            input: inputLayer,
            hidden: [hiddenLayer, hiddenLayer2],
            output: outputLayer
        });

How can I set the activation function of the neurons to be like Relu from here

https://github.com/wagenaartje/neataptic/wiki/Activation

Thanks

wagenaartje commented 7 years ago

You can set the squash of all neurons in a layer by doing the following:

var hiddenLayer = new Layer(3);
hiddenLayer.set({squash: Neuron.squash.RELU});