MTG / DeepConvSep

Deep Convolutional Neural Networks for Musical Source Separation
GNU Affero General Public License v3.0
469 stars 110 forks source link

lasagne.layers.Conv2DLayer default adds bias #11

Closed mee1o closed 6 years ago

mee1o commented 7 years ago

So no need to use lasagne.layers.BiasLayer

I found this when I print the shape of arrays in file fft_1024.pkl (iKala dataset)

These are the shapes and bias array (30,) occurs twice for each convolutional layer.

(30, 1, 1, 30) (30,) (30,) (30, 30, 10, 20) (30,) (30,) (13230, 256) (256,) (256, 13230) (13230,) (256, 13230) (13230,) (2,)

I also checked the code of lasagne.layers.Conv2DLayer, it confirms my assumption.

nkundiushuti commented 7 years ago

thanks! I wasn't aware that lasagne adds the bias by default. though I don't think it damages the performance or significantly slows down training

nkundiushuti commented 6 years ago

we will preserve this to be backwards compatible with the model we sent to MIREX in 2016