search

nerdyrodent / VQGAN-CLIP

Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.
Other
2.59k stars 428 forks source link

Do we need to train VQGAN and CLIP together? #146

Closed charlotte12l closed 2 years ago

charlotte12l commented 2 years ago

In training, do we need to train VQGAN and CLIP together? Or they are just trained separately but when inference we will use them two.

nerdyrodent commented 2 years ago

They're pre-trained.

charlotte12l commented 2 years ago

@nerdyrodent Actually I mean when I finetune(train) the model, do I just train VQGAN and CLIP separately, or train them together? I guess just separately is enough?