lucidrains / memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
MIT License
624 stars 46 forks source link

official repo? #12

Open brando90 opened 1 year ago

brando90 commented 1 year ago

curious/puzzled. Would google really release their model in pytorch? Is this the official implementation of Memorizing Transformers?

(btw, great work!)

brando90 commented 1 year ago

https://twitter.com/ChrSzegedy/status/1589492667247132672?s=20&t=1VqJB9gI-yAmv2wM6VoYiQ https://github.com/google-research/meliad