search

Unity-Technologies / com.unity.perception

Perception toolkit for sim2real training and validation in Unity
Other
909 stars 177 forks source link

Keypoint label error ? #440

Open moonsh opened 2 years ago

moonsh commented 2 years ago

I followed the tutorial to generate keypoints for the human model. Strangely, the perception camera failed to detect keypoints. Could you give me any advice to fix this problem? I am using Unity 2020.3.20f1

keypoint

moonsh commented 2 years ago

The issue was solved when I use Windows. Strangely, it's not working properly in Mac OS.

JonathanHUnity commented 2 years ago

Actually I'll reopen this so that we can look into it.

moonsh commented 2 years ago

@JonathanHUnity It's fixed?

csun commented 2 years ago

Hey there @moonsh - I'm unable to reproduce this error on Mac when following the tutorial instructions. I know you've already fixed it by switching to windows, but do you have any additional info on steps for reproducing the issue? It would be nice to know so that we can figure out how to fix this issue if it occurs for other people. Thanks!

moonsh commented 2 years ago

Hi @csun You can test with this work. You don't need to change just need to run on Mac OS. By the way, I am using MAC OS with Apple silicon. and Unity 2020.3.20f1. https://github.com/Unity-Technologies/PeopleSansPeople

The below figure from the above project. All keypoints failed like the figure above. image

csun commented 2 years ago

Interesting - I've used the PeopleSansPeople project as well and think I've actually seen this occur, though it's very rare for me. A couple more questions that would help us out, and I'll open a ticket in our internal bug tracker so we can look at this:

  1. Does this happen every single time you run the project? Or is it just some times? If it's just some times, are there any special conditions that cause it to occur more often?
  2. When you run into this issue, is the output data itself corrupted? Or is it just the visualization? To me, it looks like all the keypoints are in the right places, it's just the visualization for the bones that's messed up.

Thank you very much for your help!

moonsh commented 2 years ago

@csun

  1. Yes. This happens always.
  2. I think you are right. Seems like outputs are fine. Only visualization is messed up

Thank you !

aryan-mann commented 2 years ago

Hey @moonsh, haven't been able to reproduce this issue yet even with a fresh clone of the PeopleSansPeople repository and MacOS + Unity 2020.3.20f1 (although not Apple Silicon). From what I understand, some people on the team have ran into before so we'll mark it in our system and keep an eye out for it!

Thanks for reporting this visualization issue, I'll update this thread once we track it down and release a fix!

-- Aryan