ziyc / drivestudio

A 3DGS framework for omni urban scene reconstruction and simulation.
https://ziyc.github.io/omnire/
MIT License
486 stars 33 forks source link

Errors in human body data preprocessing #25

Open DavideA opened 2 weeks ago

DavideA commented 2 weeks ago

Hi, and thank you for sharing you repo. I would like to try fitting the omnire model on nuScenes, and I was going over the data preprocessing steps.

I am having issues in the last step, namely "5. Human Body Pose Processing". I have installed all dependencies, however I am seeing some cuda and OpenGL errors. At the beginning at the script, I see

[09/16 03:37:15] INFO No OpenGL_accelerate module acceleratesupport.py:17 loaded: No module named 'OpenGL_accelerate'

As the tracker is running, I always see

Error in forward_face_index_map_1: no kernel image is available for execution on the device

Often (but not always) OpenGL triggers an error like

Tracking : 5 🏃 ━━━╸ 19% eta : 0:02:44 time elapsed : 0:00:37 GLError( err = 12296, baseOperation = eglMakeCurrent, cArguments = ( <OpenGL._opaque.EGLDisplay_pointer object at 0x7fbe75c1aac0>, <OpenGL._opaque.EGLSurface_pointer object at 0x7fbe77c405c0>, <OpenGL._opaque.EGLSurface_pointer object at 0x7fbe77c405c0>, <OpenGL._opaque.EGLContext_pointer object at 0x7fbe75c1a640>, ), result = 0 )

and then the demo.pkl file is not created by PHALP, ultimately resulting in an error like

[09/16 03:49:07] ERROR Error processing scene 0: humanpose_process.py:140 [Errno 2] No such file or directory: 'path-to/humanpose/temp/phalp_output/results/demo_0.pkl'

Any suggestion? I suspect the issue might be in the NVIDIA driver or CUDA setups, but I'm not entirely sure.

ziyc commented 1 week ago

Hi @DavideA,

It appears the issue might be related to PHALP's environment setup. Could you please check the 4D-Humans repo and follow their environment installation instructions? If you're able to run the 4D-Humans demo successfully, our pipeline should work as well, since we have the same dependencies.