Chapter 5 - error in formula

[yonigottesman]

• [ ] ## Information

The problem arises in chapter:

• [ ] Introduction
• [ ] Text Classification
• [ ] Transformer Anatomy
• [ ] Multilingual Named Entity Recognition
• [x] Text Generation
• [ ] Summarization
• [ ] Question Answering
• [ ] Making Transformers Efficient in Production
• [ ] Dealing with Few to No Labels
• [ ] Training Transformers from Scratch
• [ ] Future Directions

Describe the bug

I think the softmax is calculated on z_t, and i is taken on the result of the softmax. not like in the book where the softmax is calculated on a single logit t,i which doesnt make sense, softmax needs all the "i"s

Expected behavior

The formula should look like this: