Closed yzh119 closed 3 weeks ago
The logits cap was applied to pre-attention logits, not attention scores.
The logits cap was applied to pre-attention logits, not attention scores.