search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.42k stars 5.15k forks source link

Make media pipe compatible with webgl #5119

Open marcusx2 opened 9 months ago

marcusx2 commented 9 months ago

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

MacOS 13.6.3

MediaPipe Tasks SDK version

0.10.9

Task name (e.g. Image classification, Gesture recognition etc.)

Image classification

Programming Language and version (e.g. C++, Python, Java)

javascript

Describe the actual behavior

Mediapipe is not usable for webgl applications, at least not out of the box

Describe the expected behaviour

make mediapipe easily usable for webgl applications

Standalone code/steps you may have used to try to get what you need

See this feature request: https://github.com/google/mediapipe/issues/5064 . It would be nice if one could use mediapipe in PlayCanvas, Babylonjs, or Unity WebGL by directly manipulating the webgl textures. There doesn't seem to be a way to currently do that.

Other info / Complete Logs

No response

marcusx2 commented 8 months ago

See https://github.com/google/mediapipe/issues/5064 as example. The idea is to use mediapipe directly with the webgl textures of PlayCanvas, Babylonjs, Unity WebGL, etc.

marcusx2 commented 8 months ago

bump