Closed yejunjin closed 1 month ago
Thanks for mentioning it @yejunjin!
@merveenoyan I believe you contributed this image initially, could you confirm? I'm happy to replace the image if so.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
System Info
The notation in last Write phase in Flash attention part of the picture, shoule be Write $O_i, l_i, m_i$ instead of $O_i, l_i, v_i$.![image](https://github.com/huggingface/text-generation-inference/assets/25998993/3ee220ac-1d62-4bbe-b2bd-23d687f30f11)
Information
Tasks
Reproduction
No Need
Expected behavior
Fix flash_attention.md