Closed EddyDavies closed 2 years ago
Hi @EddyDavies the DataSilo has a parameter max_processes
. I suggest that you set this parameter to 1 to disable multiprocessing and see whether that is a workaround https://github.com/deepset-ai/FARM/blob/004ed2c6dbd9d7a2af85d57ec89a689b9363e6c1/farm/data_handler/data_silo.py#L48
We had a similar issue a long time ago but it was for a different reason #97
Your error message says Reason: 'RuntimeError('unable to write to file </torch_1395_3740776664>')
. Maybe it's a problem with write permissions?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 21 days if no further activity occurs.
Describe the bug As DataSilo is being run to load the training data it just errors out, not sure why, sorry I don't have more details. Following the notebook in this article.
Error message
Expected behavior A clear and concise description of what you expected to happen.
Additional context Add any other context about the problem here, like type of downstream task, part of etc..
To Reproduce Steps to reproduce the behavior
System: