help for face extraction.

[fonkypigeon]

Hi,

I'm playing around with ofx face tracker for couple of days, and it's a Wonderfull thing ! thanks for that. I'm almost reaching my goal, I need to extract my face from the tracking, Thanks to the face extraction example, I'm done with it, but I still have an issue : I want to modify the shape I get from the example : right now, the eyes and the mouth are masked. I'd like to modify this shape, at least to have the eyes and mouth as well captured on the texture. Could you point me out the place to modify this mask/mesh ? I've been trying to comment out plenty of part of the code, but I still didn't find where this gabarit is draw.

Thanks a lot,

Flo

[fonkypigeon]

Hi, Actually I finally discover it was face.tri which was creating this mask area. I try to figure out how to midday this file, but I can't find a visual way to do it... any help ?

Thanks,

Flo

[Javingka]

Hi @fonkypigeon
Could you finally achieve your goal?. I'm trying to do something similar.

[fonkypigeon]

Hi @Javingka,

No unfortunately I wasn't able to do so. I hacked my way in another direction, masking out the face on a stabilzed image. I used Syphon to output my stabilize tracking to a realtime compositing software where I masked it out for my final output.

If you end up finding a solution, I would love to know it! If you don't mind sharing. I'm not a really good developper, It's probably why I didn't go that far, and use a third-part software to reach my goal ;-)

cheers,

Flo

[Javingka]

Thanks @fonkypigeon, and sure, I'll tell you if I came to some solution.

[Javingka]

@fonkypigeon I came to a work around to this.

face.tri has a list defining the triangles that conforms the mask. If you see the file is a list with three number per row. each row (is a triangle) and each number is an index.

To figure out whats are the positions that those index are referring to, I print out the points drawing the actual mask inside getMesh function within ofxFaceTracker/src/ofxFaceTracker.h

Using that list, I can draw a mask using the face.tri indexes.

So, the next was replace in the face.tri file the indexes of the points that draws the eyes and mouth, to seal the holes. (see the eyes and inner mouth, the triangles draws a closed mask)

And here is the list of indexes already updated to get a mask with eyes and mouth masked, so you can replace the face.tri file.

20 21 23 21 22 23 0 1 36 15 16 45 0 17 36 16 26 45 17 18 41 25 26 46 17 36 41 26 46 45 18 19 40 24 25 47 18 41 40 25 47 46 19 20 40 23 24 47 20 21 39 22 23 42 20 40 39 23 42 47 21 22 27 21 27 39 22 27 42 27 28 42 27 28 39 28 42 47 28 39 40 1 36 41 15 45 46 1 2 41 14 15 46 28 29 40 28 29 47 2 40 41 14 46 47 2 29 40 14 29 47 2 3 29 13 14 29 29 30 31 29 30 35 3 29 31 13 29 35 30 32 33 30 33 34 30 31 32 30 34 35 3 4 31 12 13 35 4 5 48 11 12 54 5 6 48 10 11 54 6 48 59 10 54 55 6 7 59 9 10 55 7 58 59 9 55 56 8 57 58 8 56 57 7 8 58 8 9 56 4 31 48 12 35 54 31 48 49 35 53 54 31 49 50 35 52 53 31 32 50 34 35 52 32 33 50 33 34 52 33 50 51 33 51 52 48 49 65 49 65 50 50 65 64 50 51 64 51 52 64 64 63 52 52 53 63 53 54 63 54 55 63 55 56 63 56 63 64 56 57 64 64 65 57 57 58 65 58 59 65 48 59 65

---

Now I am trying to include the forehead in the mask, this is more complicated