Open ethancohen123 opened 1 year ago
Anyone has an idea about this ? @lucidrains
Hi. If you want to use pretrained language model, you are actually using the text embedding of that model.
text_emb
in DALLE
__init__
function. Now, instead of using nn.Embedding
to create new text embedding, you can use torch.load
to load pretrained weight saved in step 1.Example: link
Is it possible to use and train dalle with an external ( frozen) text encoder ( as those available in hugging face) ?