Unity-Technologies / com.unity.perception

Perception toolkit for sim2real training and validation in Unity
Other
892 stars 172 forks source link

3D object labeler does not work with synthetic human #621

Open LeonardMendicantBias opened 2 months ago

LeonardMendicantBias commented 2 months ago

Hi, I am utilizing the synthetic human and perception packages to generate training data for deep learning networks. I followed the guides on both readme documentation and obtained 2D object detection annotation for humans. However, when I add a 3D object labeler to a perception camera, Unity reports an error as shown image

The error persists even on a completely new, freshly initialized Unity project. If I understand correctly, the error says that one of the inputs (vertexBuffer) to the "Compute3DbbAsync" function is null and somehow causes a memory leak.

Another weird thing is that when I generate 100 interactions. The same error only occurs for 94 iterations but not the last 6. Thus, I could only obtain 6 training data instead of 100. Note that when I turn off the 3D object labeler (only enable the 2D object labeler), the simulation works well and I can obtain 100 training samples.

Since I am not an expert on Unity, Perception, or Synthetic human package. Does anyone know where I should start to debug?