Unity-Technologies / com.unity.perception

Perception toolkit for sim2real training and validation in Unity
Other
929 stars 177 forks source link

Blender model not working with keypointlabeler #507

Open yashgharat opened 2 years ago

yashgharat commented 2 years ago

So I walked through the human pose labeling that was found in the repo but that was using the COCO keypoint template. However I had my own model with rig that I wanted to use and while it was not a humanoid rig, it was a hand with a simple rig, just to try out the perception package. I saw that in the PoseSample scene and even the original Human Pose Labeling shows how to do this with joint labels and a keypoint template. Both of those samples work for me, even when I import them into my project. I have tried the current unity version 2021.3.2f1 and also the previous 2020.3.36f1. I have also tried using the BoxKeypointTemplate from the sample repo that worked but it still does not matter.

When I say it doesn't work, I mean that in the captures file, the keypoints are empty, as seen below in the second object with the "keypoints" id, which are the keypoints from the hand model I had. However, the "box_keypoints" object is using my custom keypoint Template but on the cube imported from the sample repo. I also tried doing this with a simple cube from blender and that also did not work.

image

Is there a specific way to export the blend file into unity to use?

I can provide more files if needed.

yashgharat commented 2 years ago

Just to update. FBX exports from Blender versions 3.2, 2.83 ,and 2.82 do not work but 2.80 and prior do. I am not sure why.