awjuliani / DeepRL-Agents

A set of Deep Reinforcement Learning Agents implemented in Tensorflow.
MIT License
2.23k stars 825 forks source link

How to do twice training session for the same buffer #79

Open dark16sider opened 4 years ago

dark16sider commented 4 years ago

My problem is actually creating some buffer but what stoped me boils down to not being able to do two training session if it is the same buffer the first one succed the second one don't for example v_l,p_l,e_l,g_n,v_n = self.train(episode_buffer,sess,gamma,0.0) v_l,p_l,e_l,g_n,v_n = self.train(episode_buffer,sess,gamma,0.0)

I get this error Exception in thread Thread-144: Traceback (most recent call last): File "C:\Users\PC\Miniconda3\envs\nnseries\lib\threading.py", line 916, in _bootstrap_inner self.run() File "C:\Users\PC\Miniconda3\envs\nnseries\lib\threading.py", line 864, in run self._target(*self._args, **self._kwargs) File "", line 37, in worker_work = lambda: worker.work(max_episode_length,gamma,sess,coord,saver) File "", line 314, in work self.train(fulllist[0],sess,gamma,0.0) File "", line 62, in train feed_dict=feed_dict) File "C:\Users\PC\Miniconda3\envs\nnseries\lib\site-packages\tensorflow\python\client\session.py", line 877, in run run_metadata_ptr) File "C:\Users\PC\Miniconda3\envs\nnseries\lib\site-packages\tensorflow\python\client\session.py", line 1076, in _run str(subfeed_t.get_shape()))) ValueError: Cannot feed value of shape () for Tensor 'worker_0/Placeholder_1:0', which has shape '(1, 256)' some how the shape of the buffer changes but doesn't when I do .shape