arghosh / AKT

MIT License
93 stars 31 forks source link

dropout in attention function #11

Open kwonmha opened 2 years ago

kwonmha commented 2 years ago

I saw scores = dropout(scores) in line 331 of akt.py This is the first time I see dropout applied to attention weight. Any reference or reason for this?