Multi gpu training problem

anosorae / IRRA

Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval (CVPR 2023)

MIT License

205 stars 27 forks source link

Multi gpu training problem #23

Open Qusijia opened 1 year ago

Qusijia commented 1 year ago

Thank you for your excellent work! I am very interested in your work and am currently using multiple GPUs for distributed training. As a beginner, I would like to ask if it is normal for the number of iterations of an epoch to not decrease when using multiple GOUs?

ppsychoo commented 1 year ago

Have you solve this problem? I have the same question! I am looking forward your reply!

qqbangbangbang commented 11 months ago

Splitting training tasks across multiple Gpus speeds up training, but does not affect the number of iterations in each epoch.