ml5js / ml5-next-gen

Repo for next generation of ml5.js: friendly machine learning for the web! 🤖
https://ml5js.org/
Other
69 stars 22 forks source link

Making `tfjs` runtime the default #134

Open ziyuan-linn opened 4 months ago

ziyuan-linn commented 4 months ago

After discussing with @shiffman, I am creating an issue to start a discussion about potentially switching our default runtime to tfjs instead of mediapipe.

The MediaPipe runtime has been causing some issues:

The TFJS runtime, although slightly worse in performance, seems to be more stable and without the above issues. I think it might be a good idea to set the tfjs runtime as the default for all models and have mediapipe as a more "experimental" option.

Please share your thoughts on this @gohai @MOQN!

gohai commented 4 months ago

I too would pick stability over performance, if the better-performing avenue is having those other drawbacks that impact the experience of folks using it.

Just to share some thoughts on the issues @ziyuan-linn mentioned (in case we want to explore addressing those still):

shiffman commented 4 months ago

Thank you for the thoughts @gohai! @ziyuan-linn let's go ahead and switch over to tfjs for the upcoming soft launch! We can keep issues open and revisit in the future.