Hi, I am following the examples rendering the front-3d dataset. But when I set a camera trajectory, I find a non-exist object shown in the pointcloud of the scene. I don't know what is happening here. I use the scene ""e29c9cea-a331-4062-8d95-17f3f7ed8813.json" and visualize the pointcloud by translate every object of loaded_objects into a Trimesh() and use open3d to visualize the point cloud.
And when I follow this trajectory to get the rendered image, I found a sofa, which is not appeared on the point cloud.
That cause the observed image become black like this.
Minimal code example
scene_pcd = o3d.geometry.PointCloud()
floor_heights = []
for obj in loaded_objects:
if not isinstance(obj,bproc.types.MeshObject):
continue
category = mapping.label_from_id(obj.get_cp('category_id'))
obj_mesh = obj.mesh_as_trimesh().apply_transform(obj.get_local2world_mat())
new_mesh = o3d.geometry.TriangleMesh()
new_mesh.vertices = o3d.utility.Vector3dVector(obj_mesh.vertices)
new_mesh.triangles = o3d.utility.Vector3iVector(obj_mesh.faces)
new_mesh.vertex_normals = o3d.utility.Vector3dVector(obj_mesh.vertex_normals)
new_pcd = new_mesh.sample_points_uniformly(1000000)
new_pcd = new_pcd.voxel_down_sample(0.05)
new_pcd.colors = o3d.utility.Vector3dVector(np.ones_like(np.array(new_pcd.points)) * 0.4)
scene_pcd = scene_pcd + new_pcd
scene_pcd = scene_pcd.voxel_down_sample(0.05)
if 'floor' in category:
if len(floor_heights) == 0:
floor_heights.append(np.array(new_pcd.points)[:,2].mean())
else:
distance = np.array(floor_heights) - np.array(new_pcd.points)[:,2].mean()
if np.min(distance) > 1.0:
floor_heights.append(np.array(new_pcd.points)[:,2].mean())
Describe the issue
Hi, I am following the examples rendering the front-3d dataset. But when I set a camera trajectory, I find a non-exist object shown in the pointcloud of the scene. I don't know what is happening here. I use the scene ""e29c9cea-a331-4062-8d95-17f3f7ed8813.json" and visualize the pointcloud by translate every object of loaded_objects into a Trimesh() and use open3d to visualize the point cloud. And when I follow this trajectory to get the rendered image, I found a sofa, which is not appeared on the point cloud. That cause the observed image become black like this.
Minimal code example
Files required to run the code
No response
Expected behavior
How does this happen?
BlenderProc version
Github main branch