search

justadudewhohacks / face-api.js

JavaScript API for face detection and face recognition in the browser and nodejs with tensorflow.js
MIT License
16.69k stars 3.71k forks source link

Facial expressions / sentiment recognition #17

Closed oreHGA closed 5 years ago

oreHGA commented 6 years ago

Beautiful work with the Face API 🙌😍

I was thinking... would it be possible to extend the API to extract sentiment from the detected faces or it'll be beyond the scope of the project?

justadudewhohacks commented 6 years ago

Hi,

I think that is a beautiful idea and certainly a possible extension in the future. Would you build that upon face landmark extraction? Atleast that's what I could imagine, to train a model, which performs sentiment analysis based on the 68 face landmark positions.

Do you have anything in mind? If you know any project that implements sentiment analysis from facial expressions or some data sets, that could be useful for training a model, feel free to share ;)

no-1ne commented 6 years ago

That would be a great approach and can create efficient emotion detection models vs current approaches,

Here are couple of datasets,

https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge

https://www.kaggle.com/c/emotion-detection-from-facial-expressions

justadudewhohacks commented 6 years ago

Thanks for sharing the links :)

Bajajar commented 6 years ago

You can take a look at this project https://github.com/bharathvaj1995/gender-detection-tensorflowjs

justadudewhohacks commented 5 years ago

@startupgurukul do you by any chance have access to the dataset of your first link? Looks like I can't download it.

Bajajar commented 5 years ago

@startupgurukul do you by any chance have access to the dataset of your first link? Looks like I can't download it.

You can download it from here https://drive.google.com/file/d/1HJladquPEkD0a7i2FJxhyZPv1I1TCj_p/view?usp=sharing

justadudewhohacks commented 5 years ago

Thank you!