syncdoth / RetNet

Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent, and chunkwise forward.
MIT License
226 stars 24 forks source link

Can you provide a LICENCE file #13

Closed Shubhankar-Aidetic closed 1 year ago

Shubhankar-Aidetic commented 1 year ago

I would like to use this repo for my job. I cannot do so until you add a license to the repo. Can you please do so soon?

syncdoth commented 1 year ago

I have added an MIT license to the main branch, following the license of torchscale, which should contain the official implementation of RetNet.

Bear in mind; this is NOT the official repo, and I am not the author of the Retentive Network Paper.

Shubhankar-Aidetic commented 1 year ago

Hey thanks for the quick update! I understand that this isnt the official repo.