microsoft / i-Code

MIT License
1.68k stars 161 forks source link

CoDi: Fine Tuning #130

Open danielemolino opened 6 months ago

danielemolino commented 6 months ago

I would try to finetune the model for a specific domain. Following the paper, i was able to isolate the prompt encoders for their contrastive training, but i don't know how to train the LDM without the environmental encoder. Any advice?