search

hunar4321 / reweight-gpt

Reweight GPT - a simple neural network using transformer architecture for next character prediction
https://www.brainxyz.com/
MIT License
47 stars 7 forks source link

7- Embbed Convolutions #2

Open goog opened 11 months ago

goog commented 11 months ago

hello！what is the head type?
i dont understand the emerging head, is there some tutorial or comment to detail it?

DanShai commented 11 months ago

what do you mean by type? check the youtube video I think he explained there