pytroll / pytroll-pps-runner

Pytroll runner for PPS
GNU General Public License v3.0
1 stars 8 forks source link

pps_posttroll_hook fails when using ppsRunAllParallel_inclCMaProb.py #48

Open TAlonglong opened 2 years ago

TAlonglong commented 2 years ago

The pps_posttroll_hook fails when using ppsRunAllParallel_inclCMaProb.py

Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: Exception in thread Thread-1:
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: Traceback (most recent call last):
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/multiprocessing/managers.py", line 811, in _callmethod
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     conn = self._tls.connection
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: AttributeError: 'ForkAwareLocal' object has no attribute 'connection'
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: 
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: During handling of the above exception, another exception occurred:
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: 
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: Traceback (most recent call last):
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/threading.py", line 926, in _bootstrap_inner
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     self.run()
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/site-packages/nwcsafpps_runner-0.2.2.dev105+g7af9104.d20211209-py3.7.egg/nwcsafpps_runner/pps_posttroll_hook.p
y", line 132, in run
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     retv = self.queue.get()
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "<string>", line 2, in get
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/multiprocessing/managers.py", line 815, in _callmethod
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     self._connect()
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/multiprocessing/managers.py", line 802, in _connect
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     conn = self._Client(self._token.address, authkey=self._authkey)
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/multiprocessing/connection.py", line 492, in Client
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     c = SocketClient(address)
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:   File "/software/miniconda/envs/ppsv2021/lib/python3.7/multiprocessing/connection.py", line 620, in SocketClient
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]:     s.connect(address)
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: FileNotFoundError: [Errno 2] No such file or directory
Dec  9 14:15:07 pps-v2021-a ppsv2021[4025210]: 

I think it is because the message queue messes up when used as a threaded