cuda with SAC - Githubissues

vwxyzjn / cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

http://docs.cleanrl.dev

Other

5.54k stars 631 forks source link

cuda with SAC #303

Closed WillDudley closed 1 year ago

WillDudley commented 1 year ago

Hi, I don't think cuda will work with SAC due to the use of FloatTensor, see: https://github.com/vwxyzjn/cleanrl/pull/302 for my proposed changes

Apologies for the low-effort report, just thought I'd highlight it in case it is an error

vwxyzjn commented 1 year ago

Closed by #302. Thank you @WillDudley!