OpenTexture / Paint3D

Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models, a no lighting baked texture generative model
https://paint3d.github.io/
Apache License 2.0
650 stars 26 forks source link

poor texture for my model #24

Open miaowu99 opened 1 month ago

miaowu99 commented 1 month ago

I followed the process in readme to run the program and wanted to texture my car model, but the result did not meet my expectations. May I ask where I ran it incorrectly? prompt: change "monkey head" to "red car" result: 2024-08-13 11-39-45 的屏幕截图

result of stage1/init-img-0.png: init-img-0

axis is Zup

miaowu99 commented 1 month ago

I found that the generated texture has a vertical flipping relationship with my original texture. Although I don't know why, after correcting this, the result is slightly normal, but still not good. the stage1/init-img-0.png is good, but I only have front and rear views, no left and right views, right? init-img-0 After stage2, the texture result looks terrible in a specific area, no matter how I rotate the mesh. UV_inpaint_res_0 And I also found an UV_pos.png, how to use this?

miaowu99 commented 1 month ago

before stage2: albedo after stage2: UV_inpaint_res_0 result: https://github.com/user-attachments/assets/a4a424bd-5454-4a7c-96f9-6cef43407ef9

miaowu99 commented 1 month ago

After some modifications, my results look better than before: 2024-08-14 11-48-01 的屏幕截图

  1. Make sure the model is Yup and Zfront
  2. Delete the original texture information in the model.
  3. Set pipeline_paint3d_stage2.py line53, "export_texture_only" False, to export mesh, instead of using the original mesh to load the texture.
  4. Delete paint3d_cache/* when changed the model of the same name.

Of course, there are still some issues that have not been resolved:

  1. Visible textured seams.
  2. Multi-faces problem.
  3. Blurred and inconsistent in some areas.

Are these issues inherent to the methods themselves? Is there a plan to optimize these issues in the future, or are there any better similar methods recommend? Thanks for the excellent work.

Zzlongjuanfeng commented 1 month ago

After some modifications, my results look better than before: 2024-08-14 11-48-01 的屏幕截图

  1. Make sure the model is Yup and Zfront
  2. Delete the original texture information in the model.
  3. Set pipeline_paint3d_stage2.py line53, "export_texture_only" False, to export mesh, instead of using the original mesh to load the texture.
  4. Delete paint3d_cache/* when changed the model of the same name.

Of course, there are still some issues that have not been resolved:

  1. Visible textured seams.
  2. Multi-faces problem.
  3. Blurred and inconsistent in some areas.

Are these issues inherent to the methods themselves? Is there a plan to optimize these issues in the future, or are there any better similar methods recommend? Thanks for the excellent work.

Yes, we are working on addressing the challenges of multi-face generation and inconsistencies. Thank you for your attention.

cjkangme commented 1 month ago

@miaowu99

In my opinion, if there are many holes in the texture map after stage 1, most of the original texture is masked out due to the large dilate kernel size in stage 2. So I think this could lead to a terrible-looking texture.

I think adjusting the dilate kernel size when extracting the mask could be one of the possible solutions.