search

Kaixhin / ACER

Actor-critic with experience replay
MIT License
251 stars 46 forks source link

the code of the off-policy bias correction #22

Closed ChangTang210 closed 1 year ago

ChangTang210 commented 1 year ago

Hello, i have a question about the loss, thanks.

Does bias correction loss miss the item of policies?

image

Kaixhin commented 1 year ago

Should be policies[i] at the end of https://github.com/Kaixhin/ACER/blob/master/train.py#L106 .