visualization failed on headless server

[RunningLeon]

Thanks for your error report and we appreciate it a lot.

Checklist

1. I have searched related issues but cannot get the expected help.
2. The bug has not been fixed in the latest version.

Describe the bug visualization failed on headless server

Reproduction

1. What command or script did you run?

python3 demo/pcd_demo.py \
  demo/data/kitti/000008.bin"  \
  configs/pointpillars/pointpillars_hv_secfpn_8xb6-160e_kitti-3d-car.py \
  hv_pointpillars_secfpn_6x8_160e_kitti-3d-car_20220331_134606-d42d15ed.pth

2. Did you make any modifications on the code or config? Did you understand what you have modified? No
3. What dataset did you use?

Environment

1. Please run python mmdet3d/utils/collect_env.py to collect necessary environment information and paste it here.

   
   sys.platform: linux
   Python: 3.8.13 (default, Mar 28 2022, 11:38:47) [GCC 7.5.0]
   CUDA available: True
   numpy_random_seed: 2147483648
   GPU 0: NVIDIA GeForce RTX 3090
   CUDA_HOME: /usr/local/cuda
   NVCC: Cuda compilation tools, release 11.3, V11.3.109
   GCC: gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
   PyTorch: 1.10.0+cu113
   PyTorch compiling details: PyTorch built with:
   - GCC 7.3
   - C++ Version: 201402
   - Intel(R) Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel(R) 64 architecture applications
   - Intel(R) MKL-DNN v2.2.3 (Git Hash 7336ca9f055cf1bfa13efb658fe15dc9b41f0740)
   - OpenMP 201511 (a.k.a. OpenMP 4.5)
   - LAPACK is enabled (usually provided by MKL)
   - NNPACK is enabled
   - CPU capability usage: AVX512
   - CUDA Runtime 11.3
   - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86
   - CuDNN 8.2
   - Magma 2.5.2
   - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.2.0, CXX_COMPILER=/opt/rh/devtoolset-7/root/usr/bin/c++, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.10.0, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, 

TorchVision: 0.11.0+cu113 OpenCV: 4.5.5 MMEngine: 0.7.2 MMDetection: 3.0.0 MMDetection3D: 1.1.0+47e56e1 spconv2.0: False

3. You may add addition that may be helpful for locating the problem, such as
   - How you installed PyTorch \[e.g., pip, conda, source\]
   - Other environment variables that may be related (such as `$PATH`, `$LD_LIBRARY_PATH`, `$PYTHONPATH`, etc.)

**Error traceback**
If applicable, paste the error trackback here.

[Open3D WARNING] GLFW Error: X11: The DISPLAY environment variable is missing [Open3D WARNING] Failed to initialize GLFW Traceback (most recent call last): File "demo/pcd_demo.py", line 64, in main(args) File "demo/pcd_demo.py", line 50, in main visualizer.add_datasample( File "/opt/conda/envs/torch1.10.0/lib/python3.8/site-packages/mmengine/dist/utils.py", line 360, in wrapper return func(*args, *kwargs) File "/root/workspace/mmdetection3d/mmdet3d/visualization/local_visualizer.py", line 754, in add_datasample pred_data_3d = self._draw_instances_3d(data_input, File "/root/workspace/mmdetection3d/mmdet3d/visualization/local_visualizer.py", line 575, in _draw_instances_3d self.set_points(points, pcd_mode=2) File "/opt/conda/envs/torch1.10.0/lib/python3.8/site-packages/mmengine/dist/utils.py", line 360, in wrapper return func(args, **kwargs) File "/root/workspace/mmdetection3d/mmdet3d/visualization/local_visualizer.py", line 197, in set_points self.o3d_vis.get_render_option().point_size = points_size AttributeError: 'NoneType' object has no attribute 'point_size'

**Bug fix**
If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!

[JingweiZhang12]

This bug is caused by the X display server missing on your server. It has been fixed on the latest dev-1.x.

[RunningLeon]

Great. But when do we merge dev-1.x to main branch?

[JingweiZhang12]

It's about two weeks later.