jeeliz / jeelizFaceFilter

Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).
https://jeeliz.com
Apache License 2.0
2.71k stars 535 forks source link

Additional facial expressions #111

Closed andrewdeutsch closed 4 years ago

andrewdeutsch commented 5 years ago

Is your feature request related to a problem? Please describe. Additional feature detection included in the library, to complement 'Open Your Mouth"

Describe the solution you'd like • Smile detection • Frown detection • Raised eyebrows

Describe alternatives you've considered Ideally the number of the features available in the Weboji library could be available by default in the Face Filter.

xavierjs commented 5 years ago

Hi @andrewdeutsch ,

All the features available in Weboji won't be available in FaceFilter (11 face morphs). We can only use 4 face expressions with jeeliz facefilter (the output is encoded in this way). But it is enough to implement:

We will work on this soon, I keep you tuned. Best, Xavier

andrewdeutsch commented 5 years ago

That’s great news. Thanks Xavier!

On Fri, Aug 16, 2019 at 6:25 PM Bourry Xavier notifications@github.com wrote:

Hi @andrewdeutsch https://github.com/andrewdeutsch ,

All the features available in Weboji won't be available in FaceFilter (11 face morphs). We can only use 4 face expressions with jeeliz facefilter (the output is encoded in this way). But it is enough to implement:

  • smile
  • mouth opening
  • frown (both eyes once)
  • raised eyebrows (both eyes once)

We will work on this soon, I keep you tuned. Best, Xavier

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/jeeliz/jeelizFaceFilter/issues/111?email_source=notifications&email_token=AAI5C2QI37RGICYWJI7GYUTQE4SLZA5CNFSM4IMMYPPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD4P22YA#issuecomment-522169696, or mute the thread https://github.com/notifications/unsubscribe-auth/AAI5C2RY5S2ZJ3BIZ3F7QD3QE4SLZANCNFSM4IMMYPPA .

--

xavierjs commented 4 years ago

Hi @andrewdeutsch I have added the feature :). And a demo integrating it. Mouth opening, smile and frown eyebrows work very well. Raised eyebrows is a bit more difficult to detect, especially when I am wearing glasses. You can check it here: https://jeeliz.com/demos/faceFilter/demos/threejs/cubeExpr/ Best, Xavier

andrewdeutsch commented 4 years ago

This is very helpful, thanks Xavier. Can't wait to play with it. I hope you and your family are well!

On Mon, Apr 20, 2020 at 1:18 PM Bourry Xavier notifications@github.com wrote:

Hi @andrewdeutsch https://github.com/andrewdeutsch I have added the feature :). And a demo integrating it. Mouth opening, smile and frown eyebrows work very well. Raised eyebrows is a bit more difficult to detect, especially when I am wearing glasses. You can check it here: https://jeeliz.com/demos/faceFilter/demos/threejs/cubeExpr/ Best, Xavier

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/jeeliz/jeelizFaceFilter/issues/111#issuecomment-616695476, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI5C2RNJ4D2YGIZCKOHM5LRNR7W5ANCNFSM4IMMYPPA .

-- 917.482.1004 https://www.somewonderstuff.com

xavierjs commented 4 years ago

I stay at home and I code a lot :) . I enjoy NJ countryside. I hope you and your family are doing well too. Unfortunately, I won't go to NYC before months :(