Mediapipe Web Pose Landmarker doesn't return visibility

[jays0606]

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

Mac OS

MediaPipe Tasks SDK version

No response

Task name (e.g. Image classification, Gesture recognition etc.)

Pose Estimation

Programming Language and version (e.g. C++, Python, Java)

JavaScript

Describe the actual behavior

It says in the doc mediapipe pose landmark should return visibility, but in reality the output only returns x, y, z.

Describe the expected behaviour

The visibility 0.0 ~ 1.0 should be returned along with xyz.

Standalone code/steps you may have used to try to get what you need

const poseLandmarker = await PoseLandmarker.createFromOptions(vision, {
        baseOptions: {
            modelAssetPath: `pose_landmarker_full.task`,
            delegate: "GPU",
        },
        runningMode: "VIDEO",
        numPoses: 1,
    });

And run poseLandmark.detectForVideos()
I printed out the results.

Other info / Complete Logs

No response

[ayushgdev]

Hello @jays0606 Thanks for highlighting this issue. We are able to replicate this at our end. We shall fix it soon.

[Pauatro]

I'm facing the same issue here, any updates on this ticket?

[Bilalismail]

Facing the same issue. I'm currently using Z values to determine visibility by scoring against right and left landmarks. Can you confirm if the visibility score will be coming back?

[emoc11]

Same issue here, could be greate to have it back again soon !

Thanks for your work :)

[palash-sarate]

any updates

[Filiflo]

There has been a more recent post on similar issues. They seem to still be working on it.

here are some references to posts that seem to have the same problem: typescript - same issue (last addressed 2 weeks from writing) duplicate of this issue - has been marked as such

[kuaashish]

HI @jays0606,

Could you please verify the current status using the nightly version at https://www.npmjs.com/package/@mediapipe/tasks-vision/v/0.10.12-rc.20240407? It must return the visibility due to the merged https://github.com/google/mediapipe/pull/5142. These changes are expected to be included in the upcoming major release.

Thank you!!

[github-actions[bot]]

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

[github-actions[bot]]

This issue was closed due to lack of activity after being marked stale for past 7 days.

[SinchanKM]

It's available for mediapipe web v0.10.11 released on 8th March 2024