search

Shreeyak / pytorch-lightning-segmentation-template

Semantic Segmentation on the LaPa dataset using Pytorch Lightning
Apache License 2.0
13 stars 5 forks source link

BrokenPipeError #35

Open Shreeyak opened 3 years ago

Shreeyak commented 3 years ago 
  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/queues.py", line 245, in _feed
    send_bytes(obj)
  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
BrokenPipeError: [Errno 32] Broken pipe
Shreeyak commented 3 years ago

Found one similar issue, but it was due to hdf5 reads in dataloader: https://github.com/PyTorchLightning/pytorch-lightning/issues/4605

Shreeyak commented 3 years ago

relatewd new error (on adding print to test epoch end)

  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/queues.py", line 245, in _feed
    send_bytes(obj)
  File "/home/shrek/miniconda3/envs/cleargrasp/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
Shreeyak commented 3 years ago

This error could be due to multiple processes trying to read/write the same file.