why def sync_out(self, device="cpu"): use cpu and I can't find weight averaged

[xiezhipeng-git]

I found agent def sync_out(self, device="cpu") use cpu.then I try change to gpu.then I change code def sync_out(self, device="cpu"): device = self.device or device = self.device.type 1.but it has error in async. 2.in addition I can't find weight averaged code.If there is no average weight on different machines, what is the significance of synchronizing data? Always the last number to repeat.seems ppo alyays >32step data to learn one times. it will 31 times sync loss

sync_out Fatal Python error: pygame_parachute: (pygame parachute) Segmentation Fault Python runtime state: initialized

Thread 0x00006dd0 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 231 in _feed File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00002b60 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\connection.py", line 310 in _recv_bytes File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\connection.py", line 221 in recv_bytes File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 103 in get File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy\process.py", line 94 in gather_thread File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00000fa4 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 231 in _feed File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00001750 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd\pydevd.py", line 261 in _on_run File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00006694 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd\pydevd.py", line 215 in _on_run File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00004e18 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_timeout.py", line 43 in _on_run File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00005878 (most recent call first): File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 204 in _read_line File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 222 in _on_run File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00005704 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\queue.py", line 180 in get File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 367 in _on_run File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Current thread 0x00003018 (most recent call first): File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\site-packages\torch\storage.py", line 932 in _new_shared_cuda
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\site-packages\torch\multiprocessing\reductions.py", line 121 in rebuild_cuda_tensor File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 122 in get File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 135 in get_nowait File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy\run_mode.py", line 426 in async_distributed_train File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy/main.py", line 46 in File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 124 in _run_code File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 135 in _run_module_code File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 321 in run_path File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py", line 284 in run_file File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py", line 430 in main File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy__main__.py", line 39 in
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\runpy.py", line 87 in _run_code File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\runpy.py", line 197 in _run_module_as_main