keras-team / keras

Deep Learning for humans
http://keras.io/
Apache License 2.0
61.98k stars 19.46k forks source link

Why is there no Memory Cell Kernel in ConvLSTM2D? #10971

Closed JustAnotherUsername123 closed 3 years ago

JustAnotherUsername123 commented 6 years ago

On keras.io it says that the ConvLSTM2D is based on Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting but:

"The current implementation does not include the feedback loop on the cells output"

The equations in the original paper are as follows: it = σ(Wxi∗Xt + Whi∗Ht−1 + Wci◦Ct−1 + bi) ft = σ(Wxf∗Xt + Whf∗Ht−1 + Wcf◦Ct−1 + bf) Ct = ft◦Ct−1 + it◦tanh(Wxc∗Xt + Whc∗Ht−1 + bc) ot = σ(Wxo∗Xt + Who∗Ht−1 + Wco◦Ct + bo) Ht = ot◦tanh(Ct)

If I am interpreting the code convolutional_recurrent.py correct than the equations used in the ConvLSTM2DCell are: it = σ(Wxi∗Xt + Whi∗Ht−1 + bi) ft = σ(Wxf∗Xt + Whf∗Ht−1 + bf) Ct = ft◦Ct−1 + it◦tanh(Wxc∗Xt + bc) ot = σ(Wxo∗Xt + Who∗Ht−1 + bo) Ht = ot◦tanh(Ct)

My Questions are:

elfprince13 commented 5 years ago

Bump.

elfprince13 commented 5 years ago

This appears to have been authored by @jeammimi who seems to be inactive.