search

tensorflow / tpu

Reference models and tools for Cloud TPUs.
https://cloud.google.com/tpu/
Apache License 2.0
5.2k stars 1.77k forks source link

imagenet_to_gcs.py ends with empty tfrecords #980

Open exx8 opened 2 years ago

exx8 commented 2 years ago

I try to run imagenet_to_gcs.py --raw_data_dir=/sda/Eran/imagenet/ --local_scratch_dir=/sda/Eran/downloads/TFrecords --nogcs_upload and the script runs, but I get a folder with empty TFrecords. image it seems that something went wrong. The folder of the extracted images of imagenet seems to be fine: image image I use tf 2.8. Debugging tf global ended with an empty array. Thanks

exx8 commented 2 years ago

The problem was that the script expects the samples to be under "train" and "test"; if it doesn't find these folder it just skips all the files that should have been placed there. I would expect some error or something that tell the problem.