Tsinghua-MARS-Lab / ViP3D

MIT License
133 stars 19 forks source link

How to visualize? #18

Closed miraclesheephaha closed 8 months ago

miraclesheephaha commented 8 months ago

If I want to achieve visualization, do I need to get results_nusc.json first, and then use vip3d.py to read the information of results_nusc.json? looking forward to your reply, thank you.

GentleSmile commented 8 months ago

We have not released the visualization code because the tool is complicated to deploy, see #12

miraclesheephaha commented 8 months ago

So if I write visual programming code, the data that need to be input include result_nusc.json and the label file in the nuscenes data set, right? This is mutr3d visulization.I want to output something like the picture below, and then the output trajectory is vip3d. Can it be achieved using the method mentioned above? image

Thank you for your answer.

GentleSmile commented 8 months ago

Yes, the result_nusc.json file is almost the same as the output of MUTR3D, with the only difference being that ViP3D has two additional fields: pred_outputs and pred_probs here. You can use MUTR3D to visualize detection and tracking results.

miraclesheephaha commented 8 months ago

Where is the calculation method of pred_outputs written in the program code? Because I don't know its calculation method, it is difficult to draw the results output by pred_outputs in a lidar or camera diagram. looking forward to your reply,thank you.

GentleSmile commented 8 months ago

pred_outputs is directly output by the predictor (see line), it is in the ego vehicle coordinate system (not lidar system).