Why local batch size should be 1? A bigger local batch size may cause a performance degradation? - Githubissues

SalesforceAIResearch / DiffusionDPO

Code for "Diffusion Model Alignment Using Direct Preference Optimization"

https://arxiv.org/abs/2311.12908

Apache License 2.0

220 stars 22 forks source link

Why local batch size should be 1? A bigger local batch size may cause a performance degradation? #13

Open DwanZhang-AI opened 1 month ago