jaymody / picoGPT

An unnecessarily tiny implementation of GPT-2 in NumPy.
MIT License
3.25k stars 415 forks source link

Fix mixed up dimensions in shape comments #4

Closed jameshfisher closed 1 year ago

jameshfisher commented 1 year ago

I printed the shapes when running it. I noticed these comments disagreed with the actual shapes.

jaymody commented 1 year ago

Thanks, good catch! Will also update the blog post.