search

useCallback / retnets

RETNETS is a powerful package designed to facilitate the usage of the Retentive Network by AI engineers. Whether you're working with Torch or Tensorflow, RETNET provides seamless integration and empowers you to harness the potential of Retentive Network for your AI projects.
2 stars 0 forks source link

Changelog of official implementation #3

Open donglixp opened 1 year ago

donglixp commented 1 year ago

Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .

useCallback commented 1 year ago

Hi @donglixp Thank you so much for opening this issue, actually I'm a bit busy these days, I'll make sure to update the package as soon as i can. I'm planning to make something like hf's transformers package, also make it available both in Tensorflow and Pytorch.

useCallback commented 1 year ago

@donglixp Also thank you so much for the great paper! 🚀