Colab

[johnwlambert]

Hi guys, fantastic work and thanks for releasing all these models and code. Have you all considered releasing a Colab with some demos? Could be cool to see.

[tianweiy]

Yeah, I will add this when I get time.

[abhigoku10]

@tianweiy any updates on this thread i have managed to build a colab one which is partial need to validate the results

[tianweiy]

@abhigoku10 That will be great. I am busy with some paper deadlines recently. I will get back to you soon.

[abhigoku10]

@tianweiy i ran the whole source code on colab for nuscenes v1.0mini dataset and ran the dist_demo.py with config , i passed the validation pkl file as test and it saves the predictions in pkl which is of 712bytes and in this line "resultdict, = dataset.evaluation(copy.deepcopy(predictions), output_dir=args.work_dir, testset=args.testset)" i get assert error and exit due to condition in nuscenes.py file "assert len(detections) == 6008". Can you please let me knw which command to use for viewing the predictions ie the 3D bounding on the lidar point cloud / BEV Thanks in advance

[tianweiy]

remove this assert and change this https://github.com/tianweiy/CenterPoint/blob/84fde67ac35a85b0364e10e75bfdf789d578024f/det3d/datasets/nuscenes/nuscenes.py#L42

to "v1.0-mini"

[tianweiy]

for visualization, I normally use open3d, the devkit will also produce some visualizations though

[abhigoku10]

@tianweiy do u have the code to visualize using open3d??

[tianweiy]

I am busy with other projects. I can clean up some code by this weekend. It should be quite easy to write though. This is a good example https://github.com/caizhongang/waymo_kitti_converter/blob/master/tools/dataloader_visualizer.py

However, you do need to think about nuScenes box coordinate and do some transformation

[abhigoku10]

@tianweiy sure i shall try from end but will be waiting for ur code , thanks for quick response appreciate it a lot

[tianweiy]

sorry, I am pretty occupied by ICCV deadlines. I suggest you try to modify the script I linked above or use the visualization code in the demo https://github.com/tianweiy/CenterPoint/blob/84fde67ac35a85b0364e10e75bfdf789d578024f/tools/demo.py#L11 which only supports 2d visualization but should be able to give you a general sense of the performance

[pigtigger]

https://github.com/pigtigger/CenterPoint-with-Colab/blob/main/CenterPoint.ipynb hope it can help someone

[tianweiy]

Really appreciate your work. I will add some better visualization tools in a few weeks and then you can probably submit a pull request for the notebook.

[pigtigger]

okay :) no problem I just started learning 3D object detection and CenterPoint really amazed me！

发自我的iPhone

------------------ Original ------------------ From: Tianwei Yin @.> Date: Sun,Mar 14,2021 2:08 PM To: tianweiy/CenterPoint @.> Cc: lihe ding @.>, Mention @.> Subject: Re: [tianweiy/CenterPoint] Colab (#34)

Really appreciate your work. I will add some better visualization tools in a few weeks and then you can probably submit a pull request for the notebook.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

[abhigoku10]

@pigtigger i have just added mine pls use it if needed https://github.com/abhigoku10/GoogleColab.git