Closed Robbepop closed 7 years ago
An initial version of the new topology builder is now available.
It supports:
FullyConnectedLayer
: a.k.a. DenseLayer
.ActivationLayer
It does not yet support the following layers:
ContainerLayer
: A good design for the topology API has yet to be found. Some designs are possible but there has not been a decision of preference, yet. Also ContainerLayer
currently does not cover any practical use cases that aren't already possible.InputLayer
: Input layers should not have an explicit notion in the topology builder. Besides that the current layer design does not require InputLayer
at all.ConvolutionLayer
: Not yet implemented, will require another design iteration.PoolingLayer
: Not yet implemented.For another design iteration a new issue will be opened.
The current topology builder is not flexible enough to use it for building up complex neural networks involving different layer types such as Convolutonal Layers.
The new topology build infrastructure should enforce a mirroring between abstract topology layers and concrete neural network layers.
Some thoughts on this matter has been made, results so far are:
InputLayer
in topology structure to represent the initial layer.DenseLayers
which is shorter.ActivationLayer
that is only responsible for serving the activation function. For identity activation functions this has the effect of simply leaving the activation layer away.DenseLayer
andActivationLayer
are fit to replace the current system. However, this structure makes it possible to later add layer types for convolutional layer computation to the set such as 2-dimensionalPoolingLayer
andConvolutionLayer
.