search

INFLUENCEorg / aiagents

A repository for agent components and their algorithms in reinforcement learning scenarios
Other
0 stars 0 forks source link

PPO test fail Cannot feed value of shape #17

Open Wouter1 opened 4 years ago

Wouter1 commented 4 years ago

Trying to feed env.action_space and env.observation_space into BasicComplexAgent. Now I get one test ok and one test fail:

ERROR: test_PPO_agent (test.testSumoGymAdapter.testSumoGymAdapter)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/wouter/git/aiagents/test/testSumoGymAdapter.py", line 65, in test_PPO_agent
    experiment.run()
  File "/home/wouter/git/aienvs/aienvs/runners/Experiment.py", line 58, in run
    episodeSteps, episodeReward = episode.run()
  File "/home/wouter/git/aienvs/aienvs/runners/Episode.py", line 51, in run
    obs, globalReward, done = self.step(obs, globalReward, done)
  File "/home/wouter/git/aienvs/aienvs/runners/Episode.py", line 32, in step
    actions = self._agent.step(obs, globalReward, done)
  File "/home/wouter/git/aiagents/aiagents/multi/BasicComplexAgent.py", line 17, in step
    agentActions = agentComponent.step(state, reward, done)
  File "/home/wouter/git/aiagents/aiagents/single/PPO/PPOAgent.py", line 110, in step
    self._action_output = self._get_action(self._step_output)
  File "/home/wouter/git/aiagents/aiagents/single/PPO/PPOAgent.py", line 236, in _get_action
    step_output['prev_action']))
  File "/home/wouter/git/aiagents/aiagents/single/PPO/PPO.py", line 114, in evaluate_policy
    feed_dict=feed_dict)
  File "/home/wouter/git/aienvs/venv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/home/wouter/git/aienvs/venv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1149, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 14, 7, 2) for Tensor 'observation:0', which has shape '(?, 14, 14, 1)'
Wouter1 commented 4 years ago

Alex wrote

It seems that there is some config misalignment between the agent and the environment for this test.