Implementing Layer Normalization

[gabrielrueda]

Resources

• only section 4.2
• https://github.com/rasbt/LLMs-from-scratch/blob/main/ch04/01_main-chapter-code/ch04.ipynb

Description

Read section 4.2 to learn about layer normalization. Look at external resources to learn more about the topic and then implement a class/functions needed for layer normalization

Expected Delivery Outcomes for Dec 7

• Learned about layer normalization and attempted an implementation of it