lucidrains / DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
MIT License
5.56k stars 643 forks source link

batchsize affects the quality of reconstructed images when training dvae #440

Open CCchenxiaoxue opened 2 years ago

CCchenxiaoxue commented 2 years ago

when I set batch=512, the quality of reconstructed images is worse compared with batch=8, does anyone know how to fix it? thank you~

alexriedel1 commented 2 years ago

Batch size and learning rate should be adjusted accordingly to each other. For optimizers like Adam it may not be that important but try to reduce your learning rate when you increase your batch size and vice versa