search

johko / computer-vision-course

This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face discord: hf.co/join/discord
MIT License
371 stars 123 forks source link

Add notebook for Sub-unit 13: Retention #199

Closed farrosalferro closed 4 months ago

farrosalferro commented 5 months ago

This notebook gives explanation about Retention Network in details. The structure of the notebook comprises of:

  1. LLM Challenges: Explains about the current challenges in LLM that RetNet addresses.
  2. RetNet Architecture: Explains about the overall architecture of Retention Network.
  3. Multi-scale Retention: Explains about the main proposal of the Retention Network.
  4. Implementation: The implementation of the original code and its explanation.
review-notebook-app[bot] commented 5 months ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

merveenoyan commented 4 months ago

@farrosalferro I left a very general comment, thanks a lot!

farrosalferro commented 4 months ago

Ah I see, I will migrate the content to .mdx then. Thank you!