search

vincentherrmann / pytorch-wavenet

An implementation of WaveNet with fast generation
MIT License
968 stars 225 forks source link

Dilated Causal Convolution Architecture: Skip, Gated and Residual Convs reference #33

Closed Vichoko closed 4 years ago

Vichoko commented 4 years ago

I'm trying to figure out the convolutional architecture of Dilated Causal Convolutions as stated in WaveNet paper.

I found out that this implementation has this Skip, Gated and Residual convolutions added, but i couldn't find any references about this in the original paper.

I understand that this kind of convolutions are not originally created by WaveNet, and is also user in many other contexts since 1980, but i'd like to know if WaveNet really used this architecture or it's just an optimization of the author of this repository.

Vichoko commented 4 years ago

I'm so blind, haha.

I found Residual and Skip connection reference on wavenet's paper section: 2.4 RESIDUAL AND SKIP CONNECTION

And gated reference 2.3GATED ACTIVATION UNIT