oxwhirl / smac

SMAC: The StarCraft Multi-Agent Challenge
MIT License
1.08k stars 228 forks source link

Does rollout.py work with qmix? #70

Open nsa26 opened 3 years ago

nsa26 commented 3 years ago

I am trying to evaluate qmix trained model using rollout.py but I am getting the following:

checkpoint: /home/ray_results/QMIX2/checkpoint_2/checkpoint-2 2021-03-22 17:27:39,867 INFO trainable.py:489 -- Current state after restoring: {'_iteration': 2, '_timesteps_total': None, '_time_total': 4.807272911071777, '_episodes_total': 200} Traceback (most recent call last): File "rollout.py", line 562, in run(args, parser) File "rollout.py", line 376, in run True, None) File "rollout.py", line 509, in rollout policy_id=policy_id) File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/trainer.py", line 831, in compute_action explore=explore) File "/home/.local/lib/python3.6/site-packages/ray/rllib/policy/policy.py", line 207, in compute_single_action timestep=timestep) File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/qmix/qmix_policy.py", line 287, in compute_actions explore=explore) File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 80, in get_exploration_action timestep) File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 146, in _get_torch_exploration_action epsilon = self.epsilon_schedule(self.last_timestep) File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 45, in call return self.value(t) File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 40, in value return self._value(t) File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/piecewise_schedule.py", line 53, in _value if l_t <= t < r_t: TypeError: '<=' not supported between instances of 'int' and 'NoneType'