swissspidy / media-experiments

WordPress media experiments
GNU General Public License v2.0
87 stars 1 forks source link

Recording: Update image segmentation library (blurring) #223

Open swissspidy opened 1 year ago

swissspidy commented 1 year ago

We currently use @mediapipe/selfie_segmentation for blurred background support when using the webcam.

This library is now being replaced by @mediapipe/tasks-vision, which is in early preview. We should start updating our usage accordingly.

Demo: https://codepen.io/mediapipe-preview/pen/xxJNjbN?editors=0010

New website: https://developers.google.com/mediapipe/solutions

See also:

swissspidy commented 3 months ago

Good opportunity to serve this locally and run everything in a worker (segmentation and even the canvas drawing perhaps?).

See https://gist.github.com/schmidt-sebastian/bb9b06988c8d4e09370770fbe3e9478f

swissspidy commented 2 months ago

Would be a good opportunity to move this to a web worker and use OffscreenCanvas