ZIGTinyBook / Z-Ant

GNU General Public License v2.0
6 stars 0 forks source link

See how others initialize random weights #61

Open Hitomamacs opened 1 month ago

Hitomamacs commented 1 month ago

Layer weights are not initialized completely random usually they have a defined variance and mean. look at papers and implement it

MirkoCalvi commented 3 weeks ago

and implement it inside Layer.randn()