search

PsychoinformaticsLab / pliers

Automated feature extraction in Python
https://pliers.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
296 stars 68 forks source link

Implement FaceNet clustering extractor #483

Open adelavega opened 2 years ago

adelavega commented 2 years ago

In the past we used FaceNet to extract emebeddings from faces and then cluster them using the "chinese whipers" algoritm.

Unfortunately, it required substantial hand tuning to find the correct parameters..

It's possible using UMAP and HDBSCAN algorithsm (like this for document: https://towardsdatascience.com/topic-modeling-with-bert-779f7db187e6), would make this process more automatable, and possibly could implement as a single pliers Extractor.

adelavega commented 2 years ago

Some people have tried this already; https://github.com/act-labs/video_facenet