Per epoch, there are 250k steps for the NATURE version.
With 1 million steps, this means we will get right past the human net case with just 4 epochs. In fact, it could be less if the testing epochs of 125k is included, but I don't think that's the case.
I should consider increasing the number of steps (EPSILON_DECAY in the code) so that I can better investigate the impact of my net. Maybe increasing it by 10x, so 10 million, would work?
Per epoch, there are 250k steps for the NATURE version. With 1 million steps, this means we will get right past the human net case with just 4 epochs. In fact, it could be less if the testing epochs of 125k is included, but I don't think that's the case.
I should consider increasing the number of steps (EPSILON_DECAY in the code) so that I can better investigate the impact of my net. Maybe increasing it by 10x, so 10 million, would work?