search

aigc-apps / CogVideoX-Fun

📹 A more flexible CogVideoX that can generate videos at any resolution and creates videos from images.
Apache License 2.0
486 stars 32 forks source link

4卡deepspeed训练采样器top xx 10打印相同数据 #64

Open ericthesolid opened 2 weeks ago

ericthesolid commented 2 weeks ago

请问是否正常 xx top 10 [19350, 498, 30384, 18997, 29190, 21190, 30604, 29550, 25494, 14597] 0 xx top 10 [19350, 498, 30384, 18997, 29190, 21190, 30604, 29550, 25494, 14597] 0 xx top 10 [19350, 498, 30384, 18997, 29190, 21190, 30604, 29550, 25494, 14597] 0 xx top 10 [19350, 498, 30384, 18997, 29190, 21190, 30604, 29550, 25494, 14597] 0

bubbliiiing commented 4 days ago

正常的

xiangweifeng commented 2 days ago

正常的

没太理解，那不是没块卡都训练相同的数据了吗