Song-Jingyu / PointPainting

This repository is an open-source PointPainting package which is easy to understand, deploy and run!
MIT License
238 stars 45 forks source link

About painting and camera number. #23

Closed EliomEssaim closed 1 year ago

EliomEssaim commented 2 years ago

I run codes in painting.py. I found it needs at least two cameras to complete the painting process. According to the paper, there seem no limits on the number of cameras. Now, I got a dataset that only uses one camera. (it mimics the Kitti dataset) I try to copy image_2 to image_3. But it does not work. When I run the test.py, I got a result that all metrics are 0.

Could you give me some advice on how to revise the code in painting.py to generate a normal result?

EliomEssaim commented 2 years ago

QQ截图20220705220635 I got results like this, using demo.py. It seems that there are no problems with painting, but I have no idea why I get such a terrible prediction. (The model works well on Kitti dataset) Could you give me some advice?

Song-Jingyu commented 1 year ago

It seems your dataset has been changed, have you re-trained the model?

G-hx commented 1 year ago

I have the same problem, my solution is to download image3 in kitti dataset.Do you copy image2 to image3 or download image3 in the kitti dataset?

EliomEssaim commented 1 year ago

I copy image2 to image3. The scenes recorded in my dataset are different from the Kitti dataset. If I download image3 from Kitti, it will result in a mismatch between image2 to image3. @G-hx

G-hx commented 1 year ago

The dataset I use for training is the kitti dataset. In the kitti dataset, image2 and image3 have parallax. So I am also very doubtful about whether image3 needs to copy image2 or use image3 in the kitti dataset. @[EliomEssaim]

EliomEssaim commented 1 year ago

I solved it by normalizing lidar point cloud reflectivity .

Song-Jingyu commented 1 year ago

Glad to hear that you finally solved your problem!

Yuepengxin commented 1 year ago

QQ截图20220705220635 I got results like this, using demo.py. It seems that there are no problems with painting, but I have no idea why I get such a terrible prediction. (The model works well on Kitti dataset) Could you give me some advice?

Hello, thanks for your excellent work about Pointpainting.I recently tried to run the Pointpainting in the environment of ubuntu18.04 and python3.7.The previous work has been completed, but I encountered difficulties in the final visualization step.I see that you have already visualized the point cloud, and it is still a color point cloud, so I would like to ask you some questions about the final visualization of this project. The visualizer I use is Mayavi by the original author. However, due to the problem of version or some feature packs, many methods have not been successful: image

So can you tell me, what visualizer are you using? How did you configure and install it and link to this project?Looking forward to your reply.Your suggestion would be greatly appreciated.Finally, thank you again for reading and helping.