search

rlcode / reinforcement-learning

Minimal and Clean Reinforcement Learning Examples
MIT License
3.33k stars 725 forks source link

The issue about breakout_a3c.py in 3-atari, when i execute source #90

Open rhkatjd00 opened 4 years ago

rhkatjd00 commented 4 years ago

PC1 cpu: intel i-5 no graphic card python 3.5 tensorflow 1.14 keras 2.3.0

PC2 cpu: inter i-7 rtx-2070 python 3.5 tensorflow 1.14 keras 2.3.0

When i execute breakout_a3c.py , The following problem occurs on both computers I guess that the issue is related to threading library...

Model: "model_18"

Layer (type) Output Shape Param # input_9 (InputLayer) (None, 84, 84, 4) 0

conv2d_17 (Conv2D) (None, 20, 20, 16) 4112

conv2d_18 (Conv2D) (None, 9, 9, 32) 8224

flatten_9 (Flatten) (None, 2592) 0

dense_25 (Dense) (None, 256) 663808

dense_27 (Dense) (None, 1) 257 Total params: 676,401 Trainable params: 676,401 Non-trainable params: 0

Exception in thread Thread-2: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-3: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-4: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-5: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-6: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-7: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-8: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

Exception in thread Thread-9: Traceback (most recent call last): File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner self.run() File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 207, in run action, policy = self.get_action(history) File "/home/name/AdvRL/reinforcement-learning/3-atari/1-breakout/breakout_a3c.py", line 327, in get_action policy = self.local_actor.predict(history)[0] File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training.py", line 1462, in predict callbacks=callbacks) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/training_arrays.py", line 276, in predict_loop callbacks.model.stop_training = False File "/home/name/.local/lib/python3.5/site-packages/keras/engine/network.py", line 323, in setattr super(Network, self).setattr(name, value) File "/home/name/.local/lib/python3.5/site-packages/keras/engine/base_layer.py", line 1215, in setattr if not _DISABLE_TRACKING.value: AttributeError: '_thread._local' object has no attribute 'value'

rhkatjd00 commented 4 years ago

I soved the problem by downgrading keras. => $pip3 install 'keras<2.3.0'