search

Jamie-Stirling / RetNet

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
MIT License
1.14k stars 98 forks source link

Changelog of official implementation #18

Open donglixp opened 11 months ago

donglixp commented 11 months ago

Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .

yhyu13 commented 10 months ago

@donglixp should we use the Microsoft release or this?

donglixp commented 10 months ago

@donglixp should we use the Microsoft release or this?

@yhyu13 We didn't conduct a parity check.