search

bkarab03 / PersonalNanoGPTProject

A personal exploration project based on nanoGPT, featuring modifications and learning experiments. Includes components from RetNet and XPOS. Aimed at understanding and experimenting with AI, this project is a learning journey by a beginner in the open-source community. Contributions, guidance, and feedback are welcome!
MIT License
0 stars 0 forks source link

Changelog of official implementation #1

Open donglixp opened 1 year ago

donglixp commented 1 year ago

Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .

bkarab03 commented 1 year ago

Thank you for reaching out and for your kind words about the package!

I want to clarify that I'm currently in the process of learning, and I have indeed updated the README to reflect the proper credits. The RetNet implementation within this project is not my own work, and I have credited the original author in the README, specifically pointing to Jamie-Stirling's RetNet repository. I will definitely check the official implementation.

As I'm new to the open-source community, I'm still learning the best practices and guidelines. If you notice anything wrong or if there's something I should be doing differently, please let me know. Your feedback and guidance would be greatly appreciated!