The difference of the effect of transformer with and without copy mechanism

lipiji / TranSummar

Transformer for abstractive summarization on cnn/daily-mail and gigawords

MIT License

140 stars 20 forks source link

The difference of the effect of transformer with and without copy mechanism #17

Open gaozhiguang opened 3 years ago

gaozhiguang commented 3 years ago

Hi, nice work. Have you ever tried the effect of transformer with or without copy mechanism. Thanks. The result of LSTM in the original paper is this. It seems that the use of transformer does not improve it.