search

Kaixhin / ACER

Actor-critic with experience replay
MIT License
251 stars 46 forks source link

Configurations for Atari games #18

Closed fuxianh closed 3 years ago

fuxianh commented 3 years ago

Hello, @Kaixhin . I am very glad to find your implemention for ACER in pytorch, and I want to do something based on it. However, I want to test on Atari games(pixel games) instead of Cartpole (control games). There are a lot of hyper-parameters, I wonder if I need to tune them or keep them as provided by you? Looking forward to your reply.

Kaixhin commented 3 years ago

You will need to use the hyperparameters from the original paper, plus adjust the neural network model to have convolutional layers (again, the paper should specify the architecture they used).

fuxianh commented 3 years ago

Thank you so much, I will check the hyperparameters from the original paper. By the way, have you test some Atari games with your code? How is the performance?

Kaixhin commented 3 years ago

No, I haven't tested my code with any other environments.

fuxianh commented 3 years ago

All right. Thanks again for your advice.