search

peteanderson80 / Matterport3DSimulator

AI Research Platform for Reinforcement Learning from Real Panoramic Images.
Other
481 stars 129 forks source link

Access to SimState.rgb failed. #114

Open RunweiSitu opened 2 years ago

RunweiSitu commented 2 years ago

When I access the image of a viewpoint via: state = sim.getState() state.rgb

The following error occurs: TypeError: Unable to convert function return value to a Python type! The signature was (self: MatterSim.SimState) -> object

How can we access the image of a viewpoint?

Valaybundele commented 1 year ago

Hi @peteanderson80,

I am also facing the same issue. Please let us know how to visualise the images.

Thanks

Valaybundele commented 1 year ago

Ok, so I found a solution. It's also mentioned in the readme, in the section which details the output of the simulator. To get the np array for a view, do np.array(state.rgb, copy=False). If you get an array of zeros in the output, make sure that you have downloaded the camera parameters along with the skybox images.

zhangjb416 commented 1 year ago

Ok, so I found a solution. It's also mentioned in the readme, in the section which details the output of the simulator. To get the np array for a view, do np.array(state.rgb, copy=False). If you get an array of zeros in the output, make sure that you have downloaded the camera parameters along with the skybox images.

Hi! I met the same problem that np.array(state.rgb, copy=False) return an array of zeros in the output.

But I have downloaded the camera parameters (matterport_camera_intrinsics, matterport_camera_poses, undistorted_camera_parameters) and skybox images. These data are put in a scan folder (e.g., ./Matterport3D/17DRP5sb8fy/matterport_skybox_images). Do you have any idea why the output is still an array of zeros?

Thanks a lot!

LinqingZhong commented 5 months ago

Ok, so I found a solution. It's also mentioned in the readme, in the section which details the output of the simulator. To get the np array for a view, do np.array(state.rgb, copy=False). If you get an array of zeros in the output, make sure that you have downloaded the camera parameters along with the skybox images.

Hi! I met the same problem that np.array(state.rgb, copy=False) return an array of zeros in the output.

But I have downloaded the camera parameters (matterport_camera_intrinsics, matterport_camera_poses, undistorted_camera_parameters) and skybox images. These data are put in a scan folder (e.g., ./Matterport3D/17DRP5sb8fy/matterport_skybox_images). Do you have any idea why the output is still an array of zeros?

Thanks a lot!

same issue . May I ask have you solved this problem?