RasmusBrostroem / ConnectFourRL

0 stars 0 forks source link

Resetting of eligibility traces #86

Closed jbirkesteen closed 1 year ago

jbirkesteen commented 1 year ago

Currently, we never reset the eligibility trace of the TDAgent. Could this be the explanation for worsening performance when training more than 1k games?

RasmusBrostroem commented 1 year ago

Yes, I think that we should reset the eligibility trace after each game, since the previous game has nothing to do with the current game