Try with Metahuman Animator in Unreal

[SlimeVRX]

Thank you for your great work

My goal is to create my face in Unreal

https://github.com/csbhr/FFHQ-UV/assets/99313947/c10ec0d9-87e8-44c1-b690-1149079be520

Download: tin_0_1024.zip

[SlimeVRX]

Download: Dilireba_001.zip

[SlimeVRX]

This is UV-sample file 000000

I have a question: Why is my texture not of the same quality as in the dataset? The texture is smoother, less detailed

[SlimeVRX]

This is the texture file when I run the file 000000: less detail than texture sample, wrinkles on the forehead are no longer visible

Download: 000000_front.zip

[SlimeVRX]

Hi @csbhr

Metahuman Animator has just been released.

Do you have any plans to create a large dataset with the help of Metahuman Animator?

I would like to join in helping to create high-quality texture datasets

Thank you!

[foocker]

Hi @csbhr

Metahuman Animator has just been released.

Do you have any plans to create a large dataset with the help of Metahuman Animator?

I would like to join in helping to create high-quality texture datasets

Thank you!

i have some questions:

1. for a given topology, for any image input, it can output a uvmap coresspond the input image. why the main work is data generation?
2. why your main goal also is creating high-quality texture datasets?
3. are BFM09, Deep3D, 3DDFA_v2, FLAME, HIFI3D, 3DMM etc can export ue4/5 for rendering?

[SlimeVRX]

Hi @foocker

I am interested in creating a 3D virtual human, so I have 2 goals mesh and texture

• Mesh: There are a lot of work at realy3dface.com - synthesize the most accurate mesh estimation articles

• Texture: According to Unreal standards - Metahuman needs (DIFF, NORM, ROUGH, SSS) map. Currently most of the articles are doing BaseColor (DIFF) map. And there is no dataset of high quality textures like FFHQ-UV

Creating a high quality dataset (DIFF, NORM, ROUGH, SSS) map is necessary

DigitalEmily2 Project

[foocker]

Hi @foocker

I am interested in creating a 3D virtual human, so I have 2 goals mesh and texture

* Mesh: There are a lot of work at realy3dface.com - synthesize the most accurate mesh estimation articles

* Texture: According to Unreal standards - Metahuman needs (DIFF, NORM,  ROUGH, SSS) map. Currently most of the articles are doing BaseColor (DIFF) map. And there is no dataset of high quality textures like FFHQ-UV

Creating a high quality dataset (DIFF, NORM, ROUGH, SSS) map is necessary

DigitalEmily2 Project

thx reply! You are starting from an industrial point of view, I also have such needs. realy3dface.com ls good.

1. i`m curious, is infinigen can do this? or have you using the OmniObject3D data?
2. may be the company of 影眸 has data meet these property.
3. is HRN's mesh meet the industrial requirements? or join the pipeline?

[SlimeVRX]

Hi,

1. I don't use OmniObject3D data, see more prolificdreamer or Control4D or Panohead
2. Looking forward to Deemos.com to share their dataset
3. Sorry! I'm still learning, there's not a complete process yet

[MilesTheProwler]

This FFHQ-UV model can output 3D obj or just UV texture? If can output 3D obj, which .py should I run ?

[SlimeVRX]

This FFHQ-UV model can output 3D obj or just UV texture?

You can download to see output format

If can output 3D obj, which .py should I run ?

FFHQ-UV code is very easy to run. Please run step-to-step

[pyh007]

你好，遇见这个错误是什么原因呢？

Error: 'Endpoint'. MS API error, sleep 2 minutes and retry 1-st.

[SlimeVRX]

你好，遇见这个错误是什么原因呢？

Error: 'Endpoint'. MS API error, sleep 2 minutes and retry 1-st.

I dont have MS API, I read sample MS API and reuse these values

Please create a new issue.

[pyh007]

不用去调这个api是怎么获取那些值的呢

[SlimeVRX]

不用去调这个api是怎么获取那些值的呢

I read sample MS API and reuse these values

[MilesTheProwler]

@SlimeVRX could you please accept my we chat request?

[SlimeVRX]

Yes!

[pyh007]

可以加个你的微信吗，你微信多少

[SlimeVRX]

Please add my wechat

[pyh007]

好的 谢谢 我加你了

[hzhou17]

Please add my wechat

Sir, how can I add you on wechat? What is your id?

[hzhou17]

好的 谢谢 我加你了

请问一下大佬微信怎么加的

[SlimeVRX]

Please add my Wechat

[csbhr]

This is the texture file when I run the file 000000: less detail than texture sample, wrinkles on the forehead are no longer visible

Download: 000000_front.zip

@SlimeVRX Thanks for your kind reply about this work.

From this UV-texture map, you seem to use RGB Fitting for producing the UV-texture map.

However, we provide two ways to generate a UV-texture map from a given facial image (see here):

1. Facial editing + texture unwrapping (Section 3.1 of the paper).
   • The proposed FFHQ-UV dataset is created from the FFHQ dataset in this way.
   • The generated textures are directly extracted from facial images, so they are detailed and with high-quality.
2. RGB fitting (Section 4.2 of the paper).
   • This is the proposed 3D face reconstruction algorithm, which uses FFHQ-UV dataset to train a nonlinear texture basis.
   • The textures are generated by a GAN-based texture decoder, sometimes with less detail than texture maps in the FFHQ-UV dataset. This is mainly due to the limitations of the nonlinear texture basis design and training.

[SlimeVRX]

Sorry, I will feedback soon!

[SlimeVRX]

Hi everyone,

I said I would assist everyone with the issues over the weekend. Now that I have time, create issues and tag me, I will help everyone

Sorry my WeChat is not available at the moment (I left my phone at the office)

[pyh007]

大家好，

我说我会在周末协助大家解决问题。现在我有时间，创建问题并标记我，我会帮助每个人

对不起，我的微信目前不可用（我把手机留在办公室了）

你好，请教个问题，如何可以让生成贴图的速度变快。如果用第二种方法，可以不生成obj文件这样会让生成速度变快吗

[Simplex2000]

好的 谢谢 我加你了

大佬，可以加个微信吗？

[foocker]

。。这加微信是啥情况，没看懂。

[Simplex2000]

。。这加微信是啥情况，没看懂。

SlimeVRX这人是机器人?我看之前有人加他,他还同意了

[SlimeVRX]

Hi, I chat with @pyh007 on Wechat. He asks a lot.

[xuduo18311199384]

您好，请问我在渲染整个Head时候会产生黑块，什么原因呢？ @SlimeVRX @foocker @pyh007