NVlabs / Deep_Object_Pose

Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
Other
1.03k stars 287 forks source link

Is there a way to extract the depth for the whole scene ?? #341

Open ArghyaChatterjee opened 8 months ago

ArghyaChatterjee commented 8 months ago

Hello @TontonTremblay ,

I was wondering is it possible to get a 16-bit depth image of the whole scene during NVISII export ??

RGB Image: 00001

Depth Image: 00001 depth

Is this a 32-bit depth image of the object only (by looking at the depth gradient of the object)? Is there any way to get the full depth of the scene during export. rather than only the depths of the objects ??

I am just adding this code block to export the depth image:

        # Export depth information to .depth.exr
        visii.render_data_to_file(
            width=opt.width,
            height=opt.height,
            start_frame=0,
            frame_count=1,
            bounce=int(0),
            options="depth",
            file_path = f"{opt.outf}/{str(i_render).zfill(5)}.depth.png"
        )

Another question is that is it possible to get other values like normals, optical flow, semantic segmentation etc. out of NVISII ??

TontonTremblay commented 8 months ago

https://github.com/owl-project/NVISII/blob/master/examples/19.depth_map_to_point_cloud.py check this example, it should be pretty easy.