Closed thomashopkins32 closed 11 months ago
Follow Karpathy's recipe for training: http://karpathy.github.io/2019/04/25/recipe/
We want to settle on what is working and what isn't. I think its clear that release 1 and release 2 have overfit quite a bit to the training data.
After running some small experiments, I have noticed the following:
1e-2
Looking to try the following next:
0.9
Follow Karpathy's recipe for training: http://karpathy.github.io/2019/04/25/recipe/
We want to settle on what is working and what isn't. I think its clear that release 1 and release 2 have overfit quite a bit to the training data.