Open MichalZajac opened 5 years ago
I think there are some problems between multiprocessing and lmdb library...I think you can fix it temporarily by set num_workers=1 in DataLoader.
num_workers=0 fixed it (1 didn't help)
Thank you guys for the anwers and your time. It works now with the num_workers=0. Great. Thx
as for 100gb, no idea why the lmdb map size was fixed; i have used 4 * dataset size instead (for jpg may increase to 10)
import os, glob
map_size = 4 * sum(os.path.getsize(f) for f in glob.glob(args.dataset + '/**', recursive=True))
As in linux it is not very problematic to set it larger than actual data sizes...but maybe it is different in windows.
Hi,
Sorry for bothering but I have following problem when trying to run train_pixelsnail.py on windows. I have succesfully trained the model and I have pretty good sample results from first step. The second step I am not sure and the 3. step fails.
The lmdb database has 100GB - is to OK?
Do you have any advice? Thank you in advance.