Closed jbirkesteen closed 1 year ago
Currently, we never reset the eligibility trace of the TDAgent. Could this be the explanation for worsening performance when training more than 1k games?
Yes, I think that we should reset the eligibility trace after each game, since the previous game has nothing to do with the current game
Currently, we never reset the eligibility trace of the TDAgent. Could this be the explanation for worsening performance when training more than 1k games?