Is there any evidence that softmax one can takes advantages over normal softmax? - Githubissues

kyegomez / AttentionIsOFFByOne

Implementation of "Attention Is Off By One" by Evan Miller

MIT License

179 stars 9 forks source link

Is there any evidence that softmax one can takes advantages over normal softmax? #6

Open ZGCTroy opened 1 year ago

ZGCTroy commented 1 year ago

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

Fund with Polar