Hello, I'd like to convert local data into the webdataset format for model training. My data consists of image files in jpg format and their corresponding image description txt files. Would it be sufficient to pack these files into tar archives for this purpose?
Hello, I'd like to convert local data into the webdataset format for model training. My data consists of image files in jpg format and their corresponding image description txt files. Would it be sufficient to pack these files into tar archives for this purpose?