dingo-actual / infini-transformer

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)
MIT License
280 stars 23 forks source link

Updated code files #15

Closed muditbhargava66 closed 6 months ago

muditbhargava66 commented 6 months ago

Bug Fixes:

Enhancements:

Please review the changes and provide any feedback or suggestions. I've tested the modifications locally, but it would be great to have additional eyes on the code before merging.

Thanks Mudit B.

dingo-actual commented 6 months ago

Thanks for the contribution! I'll take a look and resolve the merge conflicts later today.