tsyu12345 / Rikkyo-MasterPJ

【立教 特別研究】修士論文、修了研究用リポジトリ
0 stars 0 forks source link

【学習中】2万step超えたあたりで、exe環境のエラー #54

Closed tsyu12345 closed 1 week ago

tsyu12345 commented 1 month ago
[INFO] DroneAgent. Step: 20000. Time Elapsed: 13560.467 s. Mean Reward: -0.622. Mean Group Reward: 1.405. Training.
[INFO] DroneAgent. Step: 21000. Time Elapsed: 14271.881 s. Mean Reward: -0.622. Mean Group Reward: 1.415. Training.
[INFO] DroneAgent. Step: 22000. Time Elapsed: 15023.258 s. Mean Reward: -0.190. Mean Group Reward: 2.984. Training.
[WARNING] Restarting worker[0] after 'The Unity environment took too long to respond. Make sure that :
         The environment does not need user interaction to launch
         The Agents' Behavior Parameters > Behavior Type is set to "Default"
         The environment and the Python interface have compatible versions.
         If you're running on a headless server without graphics support, turn off display by either passing --no-graphics option or build your Unity executable as server build.'
C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\torch\__init__.py:696: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at ..\torch\csrc\tensor\python_tensor.cpp:453.)
  _C._set_default_tensor_type(t)
[INFO] Connected to Unity environment with package version 3.0.0-exp.1 and communication version 1.5.0
[INFO] Connected new brain: DroneAgent?team=0
[INFO] DroneAgent. Step: 23000. Time Elapsed: 15475.802 s. Mean Reward: -0.784. Mean Group Reward: 0.486. Training.
[INFO] DroneAgent. Step: 24000. Time Elapsed: 16470.828 s. Mean Reward: -0.871. Mean Group Reward: 0.455. Training.
[INFO] DroneAgent. Step: 25000. Time Elapsed: 17348.327 s. Mean Reward: -0.904. Mean Group Reward: 0.255. Training.
[INFO] DroneAgent. Step: 28000. Time Elapsed: 19588.831 s. Mean Reward: -0.880. Mean Group Reward: 0.340. Training.
[INFO] DroneAgent. Step: 29000. Time Elapsed: 20523.843 s. Mean Reward: -0.210. Mean Group Reward: 2.889. Training.
[INFO] DroneAgent. Step: 30000. Time Elapsed: 21039.407 s. Mean Reward: -1.000. Mean Group Reward: 0.000. Training.
[WARNING] Restarting worker[0] after 'The Unity environment took too long to respond. Make sure that :
         The environment does not need user interaction to launch
         The Agents' Behavior Parameters > Behavior Type is set to "Default"
         The environment and the Python interface have compatible versions.
         If you're running on a headless server without graphics support, turn off display by either passing --no-graphics option or build your Unity executable as server build.'
C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\torch\__init__.py:696: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at ..\torch\csrc\tensor\python_tensor.cpp:453.)
  _C._set_default_tensor_type(t)
[INFO] Connected to Unity environment with package version 3.0.0-exp.1 and communication version 1.5.0
[INFO] Connected new brain: DroneAgent?team=0
[INFO] Exported results\issue-#51\DroneAgent\DroneAgent-30232.onnx
[INFO] Copied results\issue-#51\DroneAgent\DroneAgent-30232.onnx to results\issue-#51\DroneAgent.onnx.
Traceback (most recent call last):
  File "C:\Users\syu\.rye\py\cpython@3.10.12\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\syu\.rye\py\cpython@3.10.12\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\Scripts\mlagents-learn.exe\__main__.py", line 7, in <module>
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\learn.py", line 267, in main
    run_cli(parse_command_line())
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\learn.py", line 263, in run_cli
    run_training(run_seed, options, num_areas)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\learn.py", line 137, in run_training
    tc.start_learning(env_manager)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents_envs\timers.py", line 305, in wrapped
    return func(*args, **kwargs)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\trainer_controller.py", line 175, in start_learning
    n_steps = self.advance(env_manager)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents_envs\timers.py", line 305, in wrapped
    return func(*args, **kwargs)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\trainer_controller.py", line 235, in advance
    num_steps = env_manager.process_steps(new_step_infos)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\env_manager.py", line 129, in process_steps
    num_step_infos = self._process_step_infos(new_step_infos)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\env_manager.py", line 145, in _process_step_infos
    self.agent_managers[name_behavior_id].add_experiences(
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\agent_processor.py", line 137, in add_experiences
    self._add_group_status_and_obs(ongoing_step, worker_id)
  File "C:\Users\syu\Products\Rikkyo-MasterPJ\.venv\lib\site-packages\mlagents\trainers\agent_processor.py", line 186, in _add_group_status_and_obs
    continuous=stored_actions.continuous[idx],
IndexError: index 3 is out of bounds for axis 0 with size 1