feifeibear / long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Apache License 2.0
350 stars 24 forks source link

fix qkvpacked strip and zigzag test error #47

Closed feifeibear closed 6 months ago