domisjustanumber
commented
1 year ago Hi @cedarconnor thanks for the kind words and whoa that is indeed quite the beast of a machine! I'm easily getting 30fps for hand tracking on my laptop so something odd is going on somewhere for sure.
The component can use anything that appears as a webcam on your machine as a video source, as it's essentially running a web browser to host MediaPipe inside TouchDesigner. So if you have a capture card or webcam you want to use as a video source in MediaPipe, you should be able to select it directly from the Webcam dropdown and skip the whole SpoutCam setup. The only caveat is (for now at least) the source capture device needs to be 1280 x 720.
If things are still running slowly, the analyze1 CHOP at the top of the screen should give you timing information from the MediaPipe process itself to tell you how long that's taking to process. If that part is taking forever, the issue is somewhere inside the MediaPipe component itself.
Otherwise if that looks reasonable, I'd try disabling the Video Device In TOP and just putting your camera directly into MediaPipe - if that fixes your FPS issue than the issue lies with SpoutCam somewhere. If it doesn't then uh not sure... it should just work. There's not really any configuration outside of that :\
cedarconnor
First of all, thanks for all the wonderful open source work!
Hand tracking works through spoutCam however the performance is quite poor. Perhaps five to seven frames per second. I'm running a high end machine. New threadrippers, 256 gigs of ram, A6000 graphics card. Windows 10 pro Version 10.0.19045 Build 19045, TD 2022.33910.
One thing I am confused about is whether there's a way to track directly from a video device or webcam. I can't get that method to work at all. Only SpoutCam input seems to work.