herbert-chen / tianchi_lvcai

天池竞赛Baseline分享(2018广东工业智造大数据创新大赛——智能算法赛,线上0.921无调参)
255 stars 98 forks source link

AttributeError: Can't pickle local object 'main.<locals>.TrainDataset' #5

Open kmust-why opened 5 years ago

kmust-why commented 5 years ago

PS F:\gan\tianchi_lvcai-master> python .\main_inception_v4.py Traceback (most recent call last): File ".\main_inception_v4.py", line 475, in main() File ".\main_inception_v4.py", line 427, in main train(train_loader, model, criterion, optimizer, epoch) File ".\main_inception_v4.py", line 143, in train for i, (images, target) in enumerate(train_loader): File "C:\Program Files\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 310, in iter return DataLoaderIter(self) File "C:\Program Files\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 167, in init w.start() File "C:\Program Files\Anaconda3\lib\multiprocessing\process.py", line 105, in start self._popen = self._Popen(self) File "C:\Program Files\Anaconda3\lib\multiprocessing\context.py", line 212, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "C:\Program Files\Anaconda3\lib\multiprocessing\context.py", line 313, in _Popen return Popen(process_obj) File "C:\Program Files\Anaconda3\lib\multiprocessing\popen_spawn_win32.py", line 66, in init reduction.dump(process_obj, to_child) File "C:\Program Files\Anaconda3\lib\multiprocessing\reduction.py", line 59, in dump ForkingPickler(file, protocol).dump(obj) AttributeError: Can't pickle local object 'main..TrainDataset' PS F:\gan\tianchi_lvcai-master> Traceback (most recent call last): File "", line 1, in File "C:\Program Files\Anaconda3\lib\multiprocessing\spawn.py", line 106, in spawn_main exitcode = _main(fd) File "C:\Program Files\Anaconda3\lib\multiprocessing\spawn.py", line 116, in _main self = pickle.load(from_parent) EOFError: Ran out of input

kmust-why commented 5 years ago

这个是pytorch版本的问题吗,我用python3.5,pytorch0.3

Lane565 commented 5 years ago

一样的问题。我用的python 3.6, pytorch 0.4.1

azyslzp commented 4 years ago

一样的问题,我用的python3.6, torch 1.1

xjtu-blacksmith commented 4 years ago

Windows 系统上 num_workers 的问题,见 README