wujingda / Human-in-the-loop-Deep-Reinforcement-Learning

(Engineering) Toward human-in-the-loop AI: Enhancing deep reinforcement learning via real-time human guidance for autonomous driving
GNU General Public License v3.0
48 stars 10 forks source link

论文程序请教 #2

Open jelly-961 opened 1 year ago

jelly-961 commented 1 year ago

吴同学,

您好!

您发表的论文《Toward human-in-the-loop AI: Enhancing deep reinforcement learning via real-time human guidance for autonomous driving》十分精彩。也非常感谢您无私的分享了论文的相关程序,我在学习您的算法时,可能发现了程序的一个小问题。主要是当算法训练的一个episode结束后,需要更新replay memory buffer时,errors在脚本中没有被定义。我附上了相应的报错信息。

File "...\TD3_based_DRL\TD3.py", line 115, in learn self.memory.batch_update(tree_idx, abs(errors.detach().cpu().numpy()) ) NameError: name 'errors' is not defined

不知您是否有空看一看程序这个部分?非常感谢您的帮助。

wujingda commented 1 year ago

您好,感谢指正! 此处bug已修复,请查看最新代码

jelly-961 commented 1 year ago

非常感谢您的及时回复!