germain-hug / Deep-RL-Keras

Keras Implementation of popular Deep RL Algorithms (A3C, DDQN, DDPG, Dueling DDQN)
528 stars 149 forks source link

A2C can't run NoFrameskip-v4? #32

Open THSWind opened 3 years ago

THSWind commented 3 years ago

Using TensorFlow backend. WARNING:tensorflow:From /root/Deep-RL-Keras/utils/networks.py:8: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From /root/Deep-RL-Keras/utils/networks.py:10: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING:tensorflow:From main.py:62: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead.

WARNING:tensorflow:From /root/miniconda3/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:68: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.

WARNING:tensorflow:From /root/miniconda3/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:508: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From /root/miniconda3/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:3837: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead.

Score: 0%| | 0/5000 [00:00<?, ? episodes/s]Traceback (most recent call last): File "main.py", line 118, in main() File "main.py", line 96, in main stats = algo.train(env, args, summary_writer) File "/root/Deep-RL-Keras/A2C/a2c.py", line 87, in train a = self.policy_action(old_state) File "/root/Deep-RL-Keras/A2C/a2c.py", line 47, in policy_action return np.random.choice(np.arange(self.act_dim), 1, p=self.actor.predict(s).ravel())[0] File "/root/Deep-RL-Keras/A2C/agent.py", line 21, in predict return self.model.predict(self.reshape(inp)) File "/root/miniconda3/lib/python3.7/site-packages/keras/engine/training.py", line 1817, in predict check_batch_axis=False) File "/root/miniconda3/lib/python3.7/site-packages/keras/engine/training.py", line 113, in _standardize_input_data 'with shape ' + str(data_shape)) ValueError: Error when checking : expected input_1 to have 5 dimensions, but got array with shape (4, 210, 160, 3) Score: 0%|