Open huangjch526 opened 2 months ago
I want to make the webdataset format of MSCOCO dataset, could you tell me how to make that in your code?
You can follow the READMe in this repo, they also use webdataset.
https://github.com/bytedance/1d-tokenizer?tab=readme-ov-file
I want to make the webdataset format of MSCOCO dataset, could you tell me how to make that in your code?