zhuzilin / ring-flash-attention

Ring attention implementation with flash attention
MIT License
571 stars 45 forks source link

[wip] Add stripe_flash_attn_varlen_* #27

Closed andreaskoepf closed 6 months ago

andreaskoepf commented 7 months ago
andreaskoepf commented 6 months ago

Currently I don't find time to complete this.