nperraud / download-celebA-HQ

Python script to download the celebA-HQ dataset from google drive
139 stars 27 forks source link

Error in make_HQ_images.py OSError: 3145728 requested and 1671040 written #10

Closed TianaCo closed 5 years ago

TianaCo commented 6 years ago

Script was working until this error:

Traceback (most recent call last):
File "/workspace/make_HQ_images.py", line 164, in pool.map(do_the_work, list(range(expected_dat)))
File "/opt/conda/lib/python3.5/multiprocessing/pool.py", line 266, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "/opt/conda/lib/python3.5/multiprocessing/pool.py", line 644, in get raise self._value
OSError: 3145728 requested and 1671040 written

VictorZuanazzi commented 5 years ago

I get an error in the line just above it

ubuntu@ip-172-31-32-19:~/GAN-ZOO/datasets/download-celebA-HQ$ python make_HQ_images.py ./CelebAHD
Loading CelebA from ./CelebAHD/celebA/Img/img_celeba
Loading CelebA-HQ deltas from ./CelebAHD/celebA-HQ
Starting a pool with 3 workers
Traceback (most recent call last):
  File "make_HQ_images.py", line 163, in <module>
    with mp.Pool(processes=num_workers) as pool:
AttributeError: __exit__
nperraud commented 5 years ago

I am sorry. I have no clue what is the problem. However, I suggest replacing the pool with a for loop. You will get a better error message. Maybe I will be able to help you then...

nperraud commented 5 years ago

Without any answer from you, I will close the issue.