💭 Is it possible to hide your face in a video stream using Vision Camera?

[maxskitt]

Question

Hi everyone,

I’m currently working with react-native-vision-camera and have a requirement to mask faces in a live video stream. The goal is to apply real-time masking to faces while capturing video.

Here’s a bit more context:

I’ve integrated VisionCameraFrameProcessor for face detection.

Is it feasible to apply real-time masking to a live video stream using Vision Camera? Any advice or insights would be appreciated!

Thanks in advance!

What I tried

I tried drawing the mask using Skia tools, but the process is very resource-intensive and takes a lot of time.

VisionCamera Version

"react-native-vision-camera": "^4.0.3",

Additional information

• [ ] I am using Expo
• [X] I have read the Troubleshooting Guide
• [X] I agree to follow this project's Code of Conduct
• [X] I searched for similar questions in the issues page as well as in the discussions page and found none.

[maintenance-hans[bot]]

Guten Tag, Hans here! 🍻

It looks like you have a valid question about applying real-time masking using react-native-vision-camera. However, please remember that we encourage users to submit feature requests or non-bug related queries through our discussions page instead of issues.

If you discover a bug or have an actual issue with the library, feel free to fill out the proper issue template to provide more context, which will help us assist you better.

In the meantime, if you're facing performance issues while using Skia, consider optimizing your drawing process or exploring other approaches.

If you want to see faster progress on this project, you might think about sponsoring mrousavy for his efforts! Check out sponsorship options here. Happy coding!

Note: If you think I made a mistake, please ping @mrousavy to take a look.

[bruno-centanaro]

I think the skia thing you mentioned with a lower fps should work for your needs