question about grads of alphas in hard Attention

kelvinxu / arctic-captions

960 stars 349 forks source link

Open denglixi opened 8 years ago

denglixi commented 8 years ago

Hello, I feel realy confused about the grads of alphas in hard attention. The source code is in line 1199:

known_grads={alphas:opt_outs['masked_cost'][:,:,None]/10. (alphas_sample/alphas) + alpha_entropy_c(tensor.log(alphas) + 1)})

Can anyone explain this to me, please?

ysjakking commented 7 years ago

@denglixi I am also confused by this. Did you find the answer？

SijieSong commented 7 years ago

@denglixi @ysjakking Did you figure out the answer? I am also confused. Can anyone help me?

shaoxuan92 commented 6 years ago

Me too...

AlvinAi96 commented 5 years ago

@denglixi @ysjakking @shaoxuan92 @SijieSong Any solution did you get? I also come across this problem.