Customize BodyPix Params

nhtua / greencam

a virtual green backdrop for OBS Studio

Apache License 2.0

195 stars 22 forks source link

Customize BodyPix Params #8

Closed CCInc closed 3 years ago

CCInc commented 3 years ago

Hey, really awesome project!

It'd be neat if there was an interface on the website to allow users to customize the parameters passed into bodyPix.load, so that they can use a better/worse model depending on what they need. And it'd allow them to mess around with settings to find one that works best.

If you think it's a good idea, I can take a look at making a PR.

nhtua commented 3 years ago

yay, Love to hear your voice. I had the same vision. My original idea was:

index.html - Editor with text input, slider to custom value
player.html - Editor submits those values to player.html and puts it into the URL query, somehow like /player.html?model=MobileNetV1&multiplier=0.75
player.html uses params from URL to run bodyPix.load

But I couldn't manage time to implement a HTML UI for it. Looking forward for new concept/design.

CCInc commented 3 years ago

I think something like this would be useful. Maybe I can adapt this page and then have it spit out a URL with parameters to input into OBS. https://flect-lab-web.s3-us-west-2.amazonaws.com/P01_wokers/t01_bodypix/index.html

One of most important hyperparameters for avoiding artifacts seems to be image size. I'll investigate how to tune it for best results given a webcam's input size.