Closed Hiccupwzy closed 6 months ago
I figure out that the question of this problem is caused by the structure of the webdataset. So can you share the inner structure of 'image.png' and 'latent.npy'.
Thank you for your help.😇😂
I have solved this question in https://github.com/Hiccupwzy/webdataset.
Could you share how to organize the facehq into webdataset, the links https://webdataset.github.io/ seems in valid.
Thank you.
/home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000048.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000049.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000050.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000051.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000052.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000053.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000054.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000055.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000056.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000057.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000058.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000059.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000060.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000061.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000062.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000063.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000064.tar') warnings.warn(repr(exn)) /home/hiccup/app/miniconda/envs/zigma/lib/python3.11/site-packages/webdataset/handlers.py:34: UserWarning: FileNotFoundError(2, 'No such file or directory', '/export/storage/facehq_sharded/train-000065.tar')