openai / sparse_attention

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
1.5k stars 191 forks source link