search

uuembodiedsocialai / FaceDiffuser

Other
136 stars 18 forks source link

How to define the mask of mouth and upper face? #17

Open Tankaishen opened 8 months ago

Tankaishen commented 8 months ago

mouth_mask = list(range(94, 114)) + list(range(146, 178)) + list(range(183, 192)) upper_mask = [x for x in range(192) if x not in mouth_mask] In the evalution of the code, I looked for how to calculate the LVE and FDD because the facial vector as a whole, how to know which positional information values represent the lip and the other region. So how to define the mask? Thanks.

Tankaishen commented 8 months ago

Also, how to get the such files like fdd.txts and lve.txts for different dataset?

paopao1027 commented 7 months ago

Also, how to get the such files like fdd.txts and lve.txts for different dataset?

Hello, have you solved this problem? How can I obtain these two files on my own dataset?

Tankaishen commented 7 months ago

Maybe we have to find out which vertex points are mouth points manually? I am a newer in 3d face and I want to know the normal way to do this.

Tankaishen commented 6 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

DarlingZzzz commented 4 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

Hello, do you know how to find the mouth points?

Tankaishen commented 4 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

Hello, do you know how to find the mouth points?

Import the .ply file into this software. Clik Geometric node, edit mode, and then on the left is the point index. blender 4637

DarlingZzzz commented 4 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

Hello, do you know how to find the mouth points?

Import the .ply file into this software. Clik Geometric node, edit mode, and then on the left is the point index. blender 4637

Thank you, I know how to get, I am new to deep learning, I also want to know how I get BIWI dataset

Tankaishen commented 4 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

Hello, do you know how to find the mouth points?

Import the .ply file into this software. Clik Geometric node, edit mode, and then on the left is the point index. blender 4637

Thank you, I know how to get, I am new to deep learning, I also want to know how I get BIWI dataset

You can apply for the dataset in its official website(see in codetalker).

DarlingZzzz commented 4 months ago

I've got to know how to choose vertex of BIWI's .ply file by blender. But the vocaset provides the .pkl file, which can't be import to the blender. Could you share the way you deal? Thanks for replying!

Hello, do you know how to find the mouth points?

Import the .ply file into this software. Clik Geometric node, edit mode, and then on the left is the point index. blender 4637

Thank you, I know how to get, I am new to deep learning, I also want to know how I get BIWI dataset

You can apply for the dataset in its official website(see in codetalker).

Yes, but I clicked on its website and it said: The dataset "Biwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2 is not available anymore. So I don't know how to get that.