search

fkodom / dilated-attention-pytorch

(Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (https://arxiv.org/abs/2307.02486)
MIT License
50 stars 9 forks source link

issues

Newest
Newest Most commented Recently updated Oldest Least commented Least recently updated