BrokenPipeError: [WinError 232] 管道正在被关闭 has occurred, when running MARL algorithm QMIX in pettingzoo

[cymmerida123]

• [ ] I have marked all applicable categories:
  • [ ] exception-raising bug
  • [ ] RL algorithm bug
  • [ ] system worker bug
  • [ ] system utils bug
  • [ ] code design/refactor
  • [ ] documentation request
  • [ ] new feature request
• [ ] I have visited the readme and doc
• [ ] I have searched through the issue tracker and pr tracker
• [ ] I have mentioned version numbers, operating system and environment, where applicable:

  import ding, torch, sys
  print(ding.__version__, torch.__version__, sys.version, sys.platform)

• version ding==v0.5.1 torch==2.3.0+cpu 3.8.0 (default, Nov 6 2019, 16:00:02) sys.version==[MSC v.1916 64 bit (AMD64)] sys.platform==win32
• warnning info [05-29 11:09:54] WARNING subprocess exception traceback: subprocess_env_manager.py:576 Traceback (most recent call last): File"d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 557, in worker_fn_robust ret = step_fn(args) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 520, in step_fn timestep = env.step(args, **kwargs) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 222, in step obs_n = self._process_obs(obs) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 255, in _process_obs obs = np.array([obs[0] for agent in self._agents]).astype(np.float32) File"d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 255, in obs = np.array([obs[0] for agent in self._agents]).astype(np.float32) KeyError: 0
• error info -Traceback (most recent call last): File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\demo.py", line 6, in serial_pipeline((main_config, create_config), seed=0) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\entry\serial_entry.py", line 97, in serial_pipeline stop, eval_info = evaluator.eval(learner.save_checkpoint, learner.train_iter, collector.envstep)
  File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\worker\collector\interaction_serial_evaluator.py", line 239, in eval timesteps = self._env.step(actions) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 744, in step self._check_data(timesteps) File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 594, in _check_data raise exceptions[0] KeyError: '\nEnv Process Exception:\n File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 557, in worker_fn_robust\n ret = step_fn(args)\n File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 520, in step_fn\n timestep = env.step(args, **kwargs)\n File "d:\yanjiusheng\yanerxia\ 毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 222, in step\n obs_n = self._process_obs(obs)\n File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 255, in _process_obs\n obs = np.array([obs[0][agent] for agent in self._agents]).astype(np.float32)\n File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\dizoo\petting_zoo\envs\petting_zoo_simple_spread_env.py", line 255, in \n obs = np.array([obs[0][agent] for agent in self._agents]).astype(np.float32)\nKeyError(0)' Exception ignored in: <function SampleSerialCollector.del at 0x000001B0CD487CA0> Traceback (most recent call last): File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\worker\collector\sample_serial_collector.py", line 212, in del File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\worker\collector\sample_serial_collector.py", line 201, in close File "d:\yanjiusheng\yanerxia\毕设\Code\DI-engine\ding\envs\env_manager\subprocess_env_manager.py", line 635, in close File "E:\Anaconda\envs\MARL\lib\multiprocessing\connection.py", line 206, in send File "E:\Anaconda\envs\MARL\lib\multiprocessing\connection.py", line 280, in _send_bytes BrokenPipeError: [WinError 232] 管道正在被关闭。