search

ml5js / ml5-library

Friendly machine learning for the web! 🤖
https://ml5js.org
Other
6.45k stars 906 forks source link

MediaPipe Holistic Support #1133

Open champierre opened 3 years ago

champierre commented 3 years ago

Dear ml5 community,

I'm submitting a new issue. Please see the details below.

→ Step 1: Describe the issue 📝

It would be great if ml5.js supports MediaPipe Holistic(https://google.github.io/mediapipe/solutions/holistic.html).

bomanimc commented 3 years ago

@champierre What a cool model! Thanks for sharing this; we'll keep this in mind. Alternatively, if you'd like to contribute an implementation as a pull request, I'd be happy to support you!

afogel commented 3 years ago

@bomanimc I'm interested in working on an implementation for a pull request -- I looked initially at the way the posenet was implemented and have been through the source of most of the models to get an idea of how to proceed.

One question I've been wrestling with -- would this simply be a wrapper around the mediapipe library? All other models seem to rely on tensorflow (or import it), but even though mediapipe's holistic model is built, at least in part, on blazepose (which is included in tensorflow), it seems as though the model does not have tensorflow as a dependency (at least, in its JS API).

Would I need to figure out how to integrate mediapipe with tensorflow.js, or could it remain a wrapper for the standalone mediapipe library? Thanks!!