search

jy0205 / LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
Other
506 stars 26 forks source link

pretraing #2

Closed 20184490 closed 10 months ago

20184490 commented 11 months ago

你好，我想问一下预训练的时候是把llama模型全参数训练了吗，我可以冻结llama参数吗，谢谢解答！

jy0205 commented 11 months ago

是的，我们是全参数训练了，可以冻结，但是效果会稍差一些

jy0205 commented 11 months ago

具体可以看论文里面的ablation study