search

gau820827 / AI-writer_Data2Doc

PyTorch Implementation of NBA game summary generator.
Apache License 2.0
83 stars 22 forks source link

decoder_attentions in showAttentions does not sum up to 1 for each timestep #20

Closed frankxu2004 closed 6 years ago

frankxu2004 commented 6 years ago

When trying to show attention score for each generated token using showAttention function, I find that each row of the decoder_attentions does not sum up to 1, which seems strange for the attention mechanism. Most values are very small. Not sure if it is a bug?

gau820827 commented 6 years ago

Close the issue since we're developing new models on the task and it's solved in fact.