search

THUDM / ImageReward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation
Apache License 2.0
1.12k stars 62 forks source link

训练问题 #82

Open zshuo7615 opened 4 months ago

zshuo7615 commented 4 months ago

采用的内存50GB的3090进行单gpu训练，批次设置为1但是依旧出现显存不足的情况，有解决方案吗

xujz18 commented 2 months ago

可以减少Transformer参数的可训练部分。

The trainable parameters of Transformer Blocks in ImageReward can be reduced.