google / nerfies

This is the code for Deformable Neural Radiance Fields, a.k.a. Nerfies.
https://nerfies.github.io
Apache License 2.0
1.59k stars 215 forks source link

Colab GPU error: Could not connect to any X display #66

Open samhubs opened 1 year ago

samhubs commented 1 year ago

I have Colab Pro and a total of 80 (4k res) frames that I have been trying to process with the Process a video into a Nerfie dataset Colab notebook but facing the following error (please see the screenshot below) while enabling the GPU runtime for Colmap feature matching. I have faced the same error with the feature extraction --SiftExtraction.use_gpu flag too but since feature extraction is done only once for each image, I managed to run it with CPU alone. However, it is not working out with the matching process - it is extremely slow and often gets hung at the first image.

Can you please help me with this? The feature matching has become a bottleneck for my entire process given the resolution of the frames. Per Colmap docs, it is more efficient to use GPU for extraction, matching, and bundle adjustment and I would like to employ them for the three processes. Thank you in advance.

To be precise, this is the error as can be seen at the bottom in the screenshot: QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-root' qt.qpa.screen: QXcbConnection: Could not connect to display Could not connect to any X display.

Screenshot from 2022-09-28 18-58-25