google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.4k stars 5.15k forks source link

Suggestion needed for Optimizing framerate using SelfieMulticlass and Pose landmarker in chrome browser #5529

Open aihkla opened 3 months ago

aihkla commented 3 months ago

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

Windows 10

MediaPipe Tasks SDK version

No response

Task name (e.g. Image classification, Gesture recognition etc.)

Image Segmentation, Pose Landmark Detection

Programming Language and version (e.g. C++, Python, Java)

Javascript in browser

Describe the actual behavior

Trying to get better framerate in windows PC running a high end nvidia GPU

Describe the expected behaviour

I am running a 4070 GPu and would like to achieve higher framerate

Standalone code/steps you may have used to try to get what you need

Hello, I would like some direction and help as I am trying to put together SelfieMulticlass and Pose landmarker detection to run at a higher FPS in chrome.

For SelfieMulticlass model, it has the highest quality background removal, that's why I didn't pick the selfie model, I notice even I hide the hair, skin and cloth detection with only background remove is active, the FPS is still relatively low.

And I notice they are not using my GPU very effectively, or at higher rate, any suggestion you can provide to aid me increase the performance? Thank you.

Other info / Complete Logs

No response

kuaashish commented 2 months ago

Hi @tyrmullen,

Do you have any suggestions for achieving higher FPS through additional configuration in Nvidia GPUs?

Thank you!!