search

LAION-AI / dalle2-laion

Pretrained Dalle2 from laion
499 stars 66 forks source link

How to finetune with the pretrained model？ #36

Closed Dicardo closed 1 year ago

Dicardo commented 1 year ago

Thanks for your amazing job !

I am trying to load the pretrained model and finetune it with the training code from dalle2-pytorch on my own data，but I had some problems that bothered me.

  1. After the model loads, I don't run the training code, but directly use the function to save the model weights，just want to verify that the whole process works, But when I replaced original decoder model with my saved model for forward inference, the resulting image became random noise.
  1. From what I know, dalle2-laion is trained using dalle2-pytorch code, why can't I reproduce this process, is there any step I am missing?
Dicardo commented 1 year ago

Solved this issue after a time. Considering that this project seems not to be updated any more, I will write down the solution if anyone encounters the same problem

Elapsedf commented 6 months ago

Solved this issue after a time. Considering that this project seems not to be updated any more, I will write down the solution if anyone encounters the same problem↳

Hello, Could you share your solution please? Thanks so much! I also encounter this question