search

ayaanzhaque / instruct-nerf2nerf

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions (ICCV 2023)
https://instruct-nerf2nerf.github.io/
MIT License
792 stars 70 forks source link

visualization without nerfstudio viewer #24

Closed pansanity666 closed 1 year ago

pansanity666 commented 1 year ago

Hi, Does the code supports visualization rather than using nerfstudio viewer? (For some reasons, I am not access to the IP of the remote server.) Best,

ayaanzhaque commented 1 year ago

You can swap to using wandb by adding --vis wandb to your command. Are you having trouble forwarding the port to view the training?

pansanity666 commented 1 year ago

To my best knowledge, forwarding the port requires the ip address of the remote server, according to the documentation from nerfstudio. However, in my case, the machine is allocated from the cluster, therefore, it seems that I can't forward the port using ssh -L since the target ip address is unknown.

ayaanzhaque commented 1 year ago

I think doing -L 7007:localhost:7007 will give you a port at 7007. Then, in your training command, add --viewer.websocket-port 7007

pansanity666 commented 1 year ago

I think doing -L 7007:localhost:7007 will give you a port at 7007. Then, in your training command, add --viewer.websocket-port 7007

If I haven't missed anything, according to https://docs.nerf.studio/en/latest/quickstart/viewer_quickstart.html, I need to run ssh -L 7007:localhost:7007 <username>@<remote-machine-ip> in my laptop. However, username and remote-machine-ip is unknown in my case.

ayaanzhaque commented 1 year ago

Wait, are you training locally or with some remote machine?

pansanity666 commented 1 year ago

Wait, are you training locally or with some remote machine?

I am using a remote machine, but for some reason, I actually don't know the ip address. The machine is automatically allocated from a cluster. I can only use it from a specified web page.

pansanity666 commented 1 year ago

Wait, are you training locally or with some remote machine?

Maybe I should download the ckpt to my laptop, and launch the viewer in my laptop using ns-viewer command, according to https://docs.nerf.studio/en/latest/reference/cli/ns_viewer.html ?

ayaanzhaque commented 1 year ago

@tancik any suggestions here?

pansanity666 commented 1 year ago

@tancik any suggestions here?

Finally, I decide to take a naive solution, that is to manually save the rendered images each iteration LOL, as mentioned here https://github.com/nerfstudio-project/nerfstudio/issues/1908#issuecomment-1544583625