search

OpenTexture / Paint3D

Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models, a no lighting baked texture generative model
https://paint3d.github.io/
Apache License 2.0
579 stars 22 forks source link

Image-conditioned model rarely condition on image #12

Closed dqj5182 closed 1 month ago

dqj5182 commented 1 month ago

I have run Paint3D in my own data, and I think image-conditioned model rarely get conditional input from image (not as pipeline perspective, but in the perspective of the final output).

May I ask how we can put more emphasis on image condition rather than text condition?

samiede commented 1 month ago

Decrease the denoising strength

Zzlongjuanfeng commented 1 month ago

Two options may enhance the influence of the image condition: 1) Increase the weight of the image condition. 2) Replace the IP-adapter model with 'ip-adapter-plus_sd15'.

dqj5182 commented 1 month ago

@Zzlongjuanfeng Thanks for your feedback! Sorry but where can I increase the weight of image condition?

Zzlongjuanfeng commented 1 month ago

@Zzlongjuanfeng Thanks for your feedback! Sorry but where can I increase the weight of image condition?

During class initialization, you can set the weight of the IP adapter using 'pipeline.set_ip_adapter_scale(xx)'.

dqj5182 commented 1 month ago

Thanks a lot! I think my issue has been solved, so I will close the issue.