AttributeError: Can't pickle local object 'BaseDataset.img_transformer.<locals>.<lambda>'

[c1a1o1]

E:\Users\Raytine\Anaconda3\python.exe F:/pytorchgan/ganimation_replicate-master/main.py --mode test --data_root datasets/celebA --batch_size 8 --max_dataset_size 150 --gpu_ids 0 --ckpt_dir ckpts/celebA/ganimation/190327_161852/ --load_epoch 30 ------------------- [ test][190508_160507]Options -------------------- aus_nc: 17
aus_pkl: aus_openface.pkl
batch_size: 8 [default: 25] beta1: 0.5
ckpt_dir: ckpts/celebA/ganimation/190327_161852/ [default: ./ckpts] data_root: datasets/celebA [default: None] epoch_count: 1
final_size: 128
gan_type: wgan-gp
gpu_ids: [0] [default: 0] img_nc: 3
imgs_dir: imgs
init_gain: 0.02
init_type: normal
interpolate_len: 5
lambda_aus: 160.0
lambda_dis: 1.0
lambda_mask: 0
lambda_rec: 10.0
lambda_tv: 0
lambda_wgan_gp: 10.0
load_epoch: 30 [default: 0] load_size: 148
log_file: logs.txt
lr: 0.0001
lr_decay_iters: 50
lr_policy: lambda
lucky_seed: 1557302708 [default: 0] max_dataset_size: 150 [default: inf] mode: test [default: train] model: ganimation
n_threads: 6
name: 190508_160507
ndf: 64
ngf: 64
niter: 20
niter_decay: 10
no_aus_noise: False
no_flip: False
no_test_eval: False
norm: instance
opt_file: opt.txt
plot_losses_freq: 20000
print_losses_freq: 100
resize_or_crop: none
results: results\celebA_ganimation_30 [default: results] sample_img_freq: 2000
save_epoch_freq: 2
save_test_gif: False
serial_batches: False
test_csv: test_ids.csv
train_csv: train_ids.csv
train_gen_iter: 5
use_dropout: False
visdom_display_id: 0 [default: 1] visdom_env: main
visdom_port: 8097
--------------------- [ test][190508_160507]End ----------------------

initialize network with normal [Info] Successfully load trained weights for net_gen. Test with Model [GANimation] Set model to Test state. Set net_gen to EVAL. Traceback (most recent call last): File "F:/pytorchgan/ganimation_replicate-master/main.py", line 16, in solver.run_solver() File "F:\pytorchgan\ganimation_replicate-master\solvers.py", line 38, in run_solver self.test_networks(self.opt) File "F:\pytorchgan\ganimation_replicate-master\solvers.py", line 106, in test_networks self.test_ops() File "F:\pytorchgan\ganimation_replicate-master\solvers.py", line 113, in test_ops for batch_idx, batch in enumerate(self.test_dataset): File "F:\pytorchgan\ganimation_replicate-master\data\data_loader.py", line 46, in iter for i, data in enumerate(self.dataloader): File "E:\Users\Raytine\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 501, in iter return _DataLoaderIter(self) File "E:\Users\Raytine\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 289, in init w.start() File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\process.py", line 105, in start self._popen = self._Popen(self) File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\context.py", line 212, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\context.py", line 313, in _Popen return Popen(process_obj) File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\popen_spawn_win32.py", line 66, in init reduction.dump(process_obj, to_child) File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\reduction.py", line 59, in dump ForkingPickler(file, protocol).dump(obj) AttributeError: Can't pickle local object 'BaseDataset.img_transformer..' Traceback (most recent call last): File "", line 1, in File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\spawn.py", line 106, in spawn_main exitcode = _main(fd) File "E:\Users\Raytine\Anaconda3\lib\multiprocessing\spawn.py", line 116, in _main self = pickle.load(from_parent) EOFError: Ran out of input

Process finished with exit code 1

[donydchen]

Hi, @c1a1o1 , what is the version of your PyTorch? It looks like the error you posted is raised by the PyTorch framework, and the project is built and tested on PyTorch version 0.4.1.

[c1a1o1]

I use PyTorch 0.4.1 and python3.5

[c1a1o1]

My celebA images is here:

F:\pytorchgan\ganimation_replicate-master\datasets\celebA\imgs

[donydchen]

My celebA images is here:

F:\pytorchgan\ganimation_replicate-master\datasets\celebA\imgs

That is exactly the same relative path as I used. I look deeper into your error info, and I think it is caused by the python multiprocessing used by the PyTorch framework. Specifically, it is related to the compatibility problem. Multiprocessing in python sometimes does not work well on Windows. So I strongly suggest you to run this project on a Ubuntu or other Linux system.

[donydchen]

@c1a1o1 , similar case and discussion can be seen at https://discuss.pytorch.org/t/cant-pickle-local-object-dataloader-init-locals-lambda/31857

[pytyeah]

I met the same problem. Have you solved it?

[Diuyon]

me too.

[sjtuplayer]

It's the problem of threads, you can set n_threads=0 or run in ubuntu