search

UWindsor-AI-Club / tutorbot

MIT License
0 stars 0 forks source link

Computing the attention weights #4

Open gabrielrueda opened 3 weeks ago

gabrielrueda commented 3 weeks ago

Resources:

https://github.com/rasbt/LLMs-from-scratch/tree/main/ch03

Description:

Read chapter 3 and replicate a attention weight calculator in our code

Expected Delivery Outcomes for Dec 7

Ali: Has already made progress on understanding how the attention weights so far. For Dec 7: will create a PR with code changes so far and comments where applicable.

gabrielrueda commented 3 weeks ago

@alialm05 are assigned to this task