open-mmlab / mmdetection3d

OpenMMLab's next-generation platform for general 3D object detection.
https://mmdetection3d.readthedocs.io/en/latest/
Apache License 2.0
5k stars 1.49k forks source link

Support for visualizing and saving image results on remote servers like colab #2972

Open sparshgarg23 opened 1 month ago

sparshgarg23 commented 1 month ago

What is the feature?

Currently when running inference on lidar based object detection and semantic segmentation,I am not able to visuzalize the results on colab.Although it;s mentioned in docs that open3d doesn't support visualization.render capabilities on colab and remote servers like jupyter notebooks,i found that actually open3d does support visualization capabilites on remote servers as well as on colab.

As such would it be possible to update local_visualizer.py to ensure that the predicted results can be visuzalized and saved in pcd format which can later on be viewed on a local machine.Currently only the predictions in json format are being saved and not the actual point cloud.

The references in below 3 bullet points inducate how to visualize on remote server as well on colab using plotly. I have tried making the changes in local_visualizer but i wasn't able to achieve the results desired

  1. https://www.open3d.org/docs/latest/tutorial/visualization/web_visualizer.html
  2. https://medium.com/@sim30217/visualize-point-cloud-using-open3d-in-colab-a05b2f780a96
  3. https://www.youtube.com/watch?v=pxInHe-266U&t=17s

Any other context?

Yes,i tried making the changes suggested from bulltet point 1-3 in local_visualizer.py I also tried installing mmdet3d on local machine but because it's windows and doesn't have GPU the installation ends up failing.