cazala / synaptic

architecture-free neural network library for node.js and the browser
http://caza.la/synaptic
Other
6.92k stars 666 forks source link

Poor scalability #333

Open ignasg opened 5 years ago

ignasg commented 5 years ago

Not sure if this is by design, but it tends to die with larger layers:

    var Layer = synaptic.Layer,
      Network = synaptic.Network;

    var totalSize = 1024;

    var inputLayer = new Layer(totalSize);
    var hiddenLayer1 = new Layer(totalSize);
    inputLayer.project(hiddenLayer1, Layer.connectionType.ALL_TO_ALL);

^^ hangs here. Sluggishly works with smaller number of neurons.

ghost commented 5 years ago

Thats Node V8 passing out. Try Node Chakra: https://nodejs.org/download/chakracore-nightly/

However for networks of this size I would recommend Tensorflow/Keras with one or more Nvidia GPUs,