nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs
https://docs.nerf.studio
Apache License 2.0
9.48k stars 1.29k forks source link

Unable to Run Examples In Google Colab #2328

Open Eatonasher opened 1 year ago

Eatonasher commented 1 year ago

I'm trying to run an example file (bulldozer) to test the repository before I try to use my own photos. I am able to run each step all the way up to the training and I receive the "🎉 Training Finished 🎉" message.

Nerf screenshot1

Despite this, nothing shows up on the viewer after the first few camera angles: image After a bit of time, it just disconnects and the "Start Training" code continues to run despite being finished.

image

To Reproduce Steps to reproduce the behavior: Follow instructions/run code provided in Colab notebook "demo.ipynb"

Expected behavior I expected to be able to run through the example on Google colab running GPU (T4) runtime, since I don't think my GPU will let me run things locally (my GPUs most recent driver is 474.44-quadro-rtx).

image

Additional context I spent all yesterday trying to build and deploy a version of instant-ngp for my computer from this repo since I'm running an older Nvidia K2000 GPU (https://github.com/NVlabs/instant-ngp#building-instant-ngp-windows--linux), I'm very much a newb with all this, so installing/uninstalling packages and ensuring which packages are compatible with what, and determining which updates are necessary for what, is very confusing to me. I tried building the software in VB2019, but got one error after another, the most persistent ones being related to CUDA and CMake. This is why I decided to have a go with Google colab - I didn't think I needed to run anything on my machine to make it work.

Please help, I just want to make a 3d model or point cloud of my property so I can import it into AutoCAD to design a garage.

brentyi commented 1 year ago

Hi!

I just gave this a try and ran into similar connection issues, I'm wondering if this might be a result of https://github.com/localtunnel/localtunnel/issues/598.

You could try navigating to the localtunnel URL (with wss:// replaced with https://), and see if it prompts you for a public IP (of the Colab instance). It did for me.

To get the public IP, I ran the following in Colab:

from requests import get

ip = get('https://api.ipify.org/').content.decode('utf8')
print(ip)

This problem is a bit weird because it should impact everyone, but I know some folks who are using Colab without issues. It's also strange that your connection works initially, but then stops.

One thing that worked without any fussing with a tunnel consent page is replacing localtunnel with ngrok:

!pip install pyngrok

from pyngrok import ngrok
public_url = ngrok.connect(7007)
print(public_url)
gno1235 commented 1 year ago

I have been experiencing the same issue recently.

The code was running fine, but in the last few days the renderer started failing with the same symptoms. I initially thought it was an issue with localtunnel, and I also tried ngrok, but that didn't work either.

While checking the browser's console for troubleshooting and checking various issues, I suddenly noticed that my smartphone was connecting to the renderer fine. I used a mobile chrome browser and my mobile network, so I'm guessing it could be an issue with my router, but I'm not sure yet.

I'd love to hear from others who have experienced similar issues.