search

myscience / retnet-pytorch

Implementation of Retention-Network in PyTorch
12 stars 1 forks source link

Changelog of official implementation #2

Open donglixp opened 1 year ago

donglixp commented 1 year ago

Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .

myscience commented 1 year ago

Thank you for the heads-up ! I have updated the repo to include the normalizations and some consistency checks!