HKUST-Aerial-Robotics / DenseSurfelMapping

This is the open-source version of ICRA 2019 submission "Real-time Scalable Dense Surfel Mapping"
683 stars 139 forks source link

NO superpixel norm #34

Open PumpkinRun opened 4 years ago

PumpkinRun commented 4 years ago

Thank you for your work,and release it. When i use ORB_slam2 model RGBd
to run Kitti dataset, sequence 00, there is no problem. And i can get the ideal result. But i processing our outdoor road data, it don't extract the super pixels, and don't generate the point cloud. I don't know which problem it is. Can you help me to solve it? I am looking forward your reply!!! Thank you!

2020-07-28 18-15-46屏幕截图

2020-07-28 18-15-56屏幕截图

2020-07-28 18-25-42屏幕截图

2020-07-28 18-13-03屏幕截图

Shame-fight commented 4 years ago

I have the same problem,and the spimage also can not received when using mynteye camera,but the surfel_color02.bag is right.so whether need to modify some code to solve these problems, except for vins_realsense.launch.looking forward for your reply.thanks~ @dvorak0 @WayneTimer @groundmelon @shaojie

PumpkinRun commented 4 years ago

Hi~~,At present, I can extract super pixels. When reading depth map, pay attention to the unit of depth image is meter. After changing the information of reading depth map in ' publisher.py ' , I can get super pixels, but the reconstruction effect is very poor, running orbslam2 rgbd mode , Core dump was appeared. Because the quliaty of depth image is poor? Hope to provide some ideas and solutions. Thanks!!! I am looking forward to your replay!

647715628 2020-07-30 14-54-47屏幕截图

Shame-fight commented 4 years ago

Successfully running the program is good news, although the effect is not very good. Can you tell me where I need to modify pubilsher.py? Are there other codes that need to be modified? I am using a stereo camera, not an rgb-d camera. I cannot run this program normally at the moment, Thanks in advance. Do you have e-mail or wechat or qq,It is more convenient to communicate with chat tools. @PumpkinRun

WANG-KX commented 4 years ago

Hi, I am here for help. @PumpkinRun can you convert the depth maps into point clouds and show me? From the normal map, it seems quite noisy.

WANG-KX commented 4 years ago

@Shame-fight The messages should be well synchronized. If you do not receive any messages please go to https://github.com/HKUST-Aerial-Robotics/DenseSurfelMapping/blob/77f65b1cfd3390ca50f1c94b1f0f250aeec2a00b/surfel_fusion/src/surfel_map.cpp#L83, https://github.com/HKUST-Aerial-Robotics/DenseSurfelMapping/blob/77f65b1cfd3390ca50f1c94b1f0f250aeec2a00b/surfel_fusion/src/surfel_map.cpp#L103, https://github.com/HKUST-Aerial-Robotics/DenseSurfelMapping/blob/77f65b1cfd3390ca50f1c94b1f0f250aeec2a00b/surfel_fusion/src/surfel_map.cpp#L93, and https://github.com/HKUST-Aerial-Robotics/DenseSurfelMapping/blob/77f65b1cfd3390ca50f1c94b1f0f250aeec2a00b/surfel_fusion/src/surfel_map.cpp#L205 for debugging. I do not know much about your senesors and configuration, so please refer to the example bag and configure your settings.

PumpkinRun commented 4 years ago

Hi, I am here for help. @PumpkinRun can you convert the depth maps into point clouds and show me? From the normal map, it seems quite noisy. Hello, Thank you for your reply. I had converted the depth maps into point clouds and discoveried it is terrible.

  1. This is kitti 00 sequence image00 , 000000.png and 000000.npy.

Screenshot from 2020-08-05 10-13-40

Screenshot from 2020-08-05 10-07-54

  1. This is owner data including image_raw and point clouds.

001247 Screenshot from 2020-08-05 10-22-24

So, It should be the problem of depth map, which makes the reconstruction result poor

WANG-KX commented 4 years ago

Hi, @PumpkinRun not sure what's on the ground. It does not seems right, right?