search

fkodom / yet-another-retnet

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)
MIT License
100 stars 15 forks source link

Changelog of official implementation #3

Closed donglixp closed 1 year ago

donglixp commented 1 year ago

Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .

fkodom commented 1 year ago

Thanks for the heads up! Will take a look 👀