search

adeshpande3 / LSTM-Sentiment-Analysis

Sentiment Analysis with LSTMs in Tensorflow
MIT License
979 stars 432 forks source link

A misunderstanding of weights #42

Open MuhammedBuyukkinaci opened 5 years ago

MuhammedBuyukkinaci commented 5 years ago

First of all, I want to thank you for this great project. I have problems in understanding this part:

WH is a matrix that stays the same across all time steps, and the weight matrix WX is different for each input.

I think this information isn't true according to Andrej Karpathy's great post.

The above specifies the forward pass of a vanilla RNN. This RNN’s parameters are the three matrices W_hh, W_xh, W_hy

Correct me if I am wrong.

Thanks in advance.