yechengxi / LightNet

Efficient, transparent deep learning in hundreds of lines of code.
Other
270 stars 116 forks source link

Split into custom layers #10

Closed alejandrojapkin closed 6 years ago

alejandrojapkin commented 6 years ago

Is it possible to create split custom layer-wise layers? If so, would you provide an example? Here's my intended implementation:

screen shot 2018-05-23 at 12 33 40
yechengxi commented 6 years ago

You'd need to write a custom layer for these operations. You can find examples in the LSTM implementation. For this type of operations it may be easier for you to switch to platforms with automatic differentiation.