search

dongjun-Lee / birnn-language-model-tf

Tensorflow implementation of Bi-directional RNN Langauge Model
39 stars 13 forks source link

experiment setting #2

Open xwzhong opened 5 years ago

xwzhong commented 5 years ago

hi, I am curious why you don't conduct a experiment use Bi-LSTM? that will make it more comparable with the paper trick.

dongjun-Lee commented 5 years ago

Hi, we can not use Bi-LSTM directly for language modeling. The reason for this is well explained at here.

OswaldoBornemann commented 5 years ago

@dongjun-Lee the blog you post is using pytorch and use Bi-LSTM for language modeling.. why you said can not use Bi-LSTM directly for language modeling?

dongjun-Lee commented 5 years ago

@tsungruihon I captured the part. image