YuliangXiu / ECON

[CVPR'23, Highlight] ECON: Explicit Clothed humans Optimized via Normal integration
https://xiuyuliang.cn/econ
Other
1.11k stars 107 forks source link

TEXTure Feature: Texture Generation Not Based on Original Input Image #52

Closed kwan3854 closed 1 year ago

kwan3854 commented 1 year ago

I recently tried out the newly added TEXTure feature, expecting it to complete the texture based on the input image as shown in the TEXTure Paper. However, the code from YuliangXiu/TEXTure seems to be determined by the prompt in the TEXTure/configs/text_guided/avatar.yaml file, specifically on line 5: text: "A gorgeously composed, high-resolution photograph of a 30 years old man wearing red shirt, blue pants, brown shoes, {} view to the camera".

Is it currently impossible to generate a texture that matches the original image provided as input to ECON? I've come to realize that this issue stems from the original https://github.com/TEXTurePaper/TEXTurePaper code not providing this functionality yet. Are there any plans to implement this feature directly in the future, or to integrate a similar functionality using another open-source texture generator?

YuliangXiu commented 1 year ago

For now, you can comment out the L10,11 and use proper prompts (infered from the input image) to get the full texture conditioned on the input view. But I have to say the results look far from OKAY. No plan to support it in the future, but please let me know if there are better options.

YuliangXiu commented 1 year ago

We recently released a new work, TeCH. Given a single image, TeCH could produce a full textured avatar with both intricate geometric details and consistent high-quality texture.

Homepage: https://huangyangyi.github.io/TeCH/ Code: https://github.com/huangyangyi/TeCH