search

cyoon1729 / RLcycle

A library for ready-made reinforcement learning agents and reusable components for neat prototyping
MIT License
299 stars 63 forks source link

Why are there two q_net in the sac2018.py file? #7

Closed TianQi-777 closed 4 years ago

TianQi-777 commented 4 years ago

This is a great job :)

I am confused about sac2018.py implementation，Why are there two q_net in the sac2018.py file? (code link) I did not see this description in the original paper Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor

In addition, I want to verify one thing. If I understand correctly, sac2018.py is the implementation of Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, and sac2019.py is the implementation of Soft Actor-Critic Algorithms and Applications. Looking forward to your reply.

TianQi-777 commented 4 years ago

sorry, I found it in the paper!