bytedance / MVDream

Multi-view Diffusion for 3D Generation
MIT License
715 stars 52 forks source link

Converting a base checkpoint to an MVDream checkpoint #4

Open KappaMund opened 9 months ago

KappaMund commented 9 months ago

Is it possible to convert other checkpoints to MVDream checkpoint, for example basic SDXL checkpoint or custom SDXL 2.1?

seasonSH commented 9 months ago

No, we fine-tune the model to learn multi-view consistency, so you will need to do the same for other models such as SDXL. For other SD2.1 models (e.g. LORA), you may try to merge the models, not sure about consistency after that though...