how to train with laion-5b dataset?

aigc-apps / CogVideoX-Fun

📹 A more flexible CogVideoX that can generate videos at any resolution and creates videos from images.

Apache License 2.0

443 stars 30 forks source link

Open jianlong-yuan opened 4 weeks ago

jianlong-yuan commented 4 weeks ago

If using large amounts of image data, how can the current reading efficiency be accelerated?

bubbliiiing commented 1 week ago

Just prepare the data in the normal way, set the type of each sample in JSON