Example dataloader code for distributed training?

iejMac / video2dataset

Easily create large video dataset from video urls

MIT License

489 stars 57 forks source link

Example dataloader code for distributed training? #331

Open rohit901 opened 3 months ago

rohit901 commented 3 months ago

Hello,

The existing sample code for WebVid-10m doesn't seem to work for distributed training across single node with multiple GPUs. Could you please provide an example code for it?

DeepDream2045 commented 3 months ago

Can you share the results_2M_train.csv file? My email is DeepDream0426@gmail.com.

Or we can connect via Discord(ID: ainerd777) Would love to collaborate on this project.

rohit901 commented 3 months ago

Sent discord request. Are you able to use the provided code for dataloader in multi-GPU environment?

chenganhsieh commented 2 months ago

same issue