cannot run preprocess data(OSError: [Errno 24] Too many open files)

uber-research / LaneGCN

[ECCV2020 Oral] Learning Lane Graph Representations for Motion Forecasting

https://arxiv.org/abs/2007.13732

Other

496 stars 131 forks source link

Open SHITIANYU-hue opened 2 years ago

SHITIANYU-hue commented 2 years ago

When I run python preprocess_data.py -m lanegcn:

it will have this error:

EloiZ commented 2 years ago

Hi! could you solve this issue? I encounter the same Thanks

wuhaoran111 commented 2 years ago

i also have this problem, does anyone has solved it?

Really confused.

SwagJ commented 2 years ago

Add import torch.multiprocessing torch.multiprocessing.set_sharing_strategy('file_system') after import statements. This fix the problem for me.

wuhaoran111 commented 2 years ago

@SwagJ Thank you. I have fixed it with sudo ulimit -n 65535 to Increase the maximum number of opening files.

CrisCloseTheDoor commented 2 years ago

Thank u all, I 've tried @SwagJ and @wuhaoran111 's solution both and fix the same problem