wyysf-98 / CraftsMan

CraftsMan: High-fidelity Mesh Generation with 3D Native Diffusion and Interactive Geometry Refiner
https://craftsman3d.github.io/
326 stars 13 forks source link

Can I generate materials and textures along with the mesh #3

Closed LaFeuilleMorte closed 3 weeks ago

LaFeuilleMorte commented 1 month ago

Thanks for your brilliant work. I tried the HF demo and I could only obtain a mesh out from an image. Can I generate the materials or textures along with the mesh.

wyysf-98 commented 1 month ago

Hi, our current work focuses on high-quality mesh generation without paying much attention to textures. We will consider this direction in our next project. In the current state, we can use some great texture generation work to achieve this, such as: DreamMat, TEXTure, SyncMVD, Fantasia3D etc.

SWAPv1 commented 4 weeks ago

DreamMat seems the best for PBR but I'm not seeing a image reference guidance feature. That is probably all we need to generate a high quality mesh using Craftsman. Plus DM.

wyysf-98 commented 4 weeks ago

DreamMat seems the best for PBR but I'm not seeing a image reference guidance feature. That is probably all we need to generate a high quality mesh using Craftsman. Plus DM.

Indeed, we are considering injecting the image reference using IP-Adaptor in the texture synthesis Diffusion. But It may take some time to implement.