Lyken17 / Efficient-PyTorch

My best practice of training large dataset using PyTorch.
1.08k stars 139 forks source link

Meet error when num_workers>=2 #13

Closed MorningstarZhang closed 4 years ago

MorningstarZhang commented 4 years ago

It seems that multiprocess can not pickle self.env because of the type"environment",is there any way to solve that?

MorningstarZhang commented 4 years ago

I try to move the definition of self.env to first visit of getitem function and it works well~

Santiago810 commented 4 years ago

I try to move the definition of self.env to first visit of getitem function and it works well~

where is the first visit of getitem function? define self.env in getitem function? @MorningstarZhang