feifeibear / long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Apache License 2.0
349 stars 24 forks source link

version 0.3.2 #78

Closed feifeibear closed 1 month ago