Open Hitomamacs opened 1 month ago
Layer weights are not initialized completely random usually they have a defined variance and mean. look at papers and implement it
and implement it inside Layer.randn()
Layer weights are not initialized completely random usually they have a defined variance and mean. look at papers and implement it