search

zzzyuqing / DreamMat

[SIGGRAPH2024] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models
MIT License
296 stars 11 forks source link

Reference image feature #7

Open SWAPv1 opened 4 months ago

SWAPv1 commented 4 months ago

Hello I am blown away by how production worthy your tool can be! Only thing I'd like is a image to texture feature instead of text to texture. Is this already possible if not do you have plans for this?

zzzyuqing commented 3 months ago

Yes, you can achieve image-to-material by using methods such as the IP-Adapter, which is quite easy to implement. However, further testing is required to ensure stability.

zhoushiwei commented 3 months ago

Yes, you can achieve image-to-material by using methods such as the IP-Adapter, which is quite easy to implement. However, further testing is required to ensure stability.

Hi , how to use IP-Adapter to merge your project ,can u give some ideas

XZYW7 commented 3 months ago

basic sd model is loaded in the method configure(self) in dreammat_guidance.py，you can load ip-adapter or other diffusers supported adapters like lora here