nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs
https://docs.nerf.studio
Apache License 2.0
9.34k stars 1.26k forks source link

Issues training pynerf (standard and synthetic) #3272

Open GateraGael opened 3 months ago

GateraGael commented 3 months ago

Having RuntimeError error when training pynef-synthetic and TypeError when training pynerf on the same dataset.

This is the error for pynerf-synthetic: RuntimeError: The size of tensor a (3) must match the size of tensor b (4) at non-singleton dimension 1

This is the error for pynerf: TypeError: RayGenerator.init() takes 2 positional arguments but 3 were given

To Reproduce Use nerfstudio docker image 1.1.2, image name on dockerhub: dromni/nerfstudio:1.1.2.

### simple command

time ns-train pynerf/pynerf-synthetic --output-dir ./train_outputs/ --viewer.websocket-port 7007 nerfstudio-data --data ./

Note: standard ns-train pynerf actually works on image dromni/nerfstudio:0.3.4 but this image is outdated. I also posted this issue on pynerf's repo: https://github.com/hturki/pynerf/issues/9#issue-2381290647

ajean757 commented 2 months ago

For the pynerf issue, this thread was able to fix it for me https://github.com/hturki/pynerf/issues/6#issuecomment-1907751869. I think it also might fix the pynerf-synthetic issue, at least I haven't run into the runtime error yet.

GateraGael commented 2 months ago

Hello installation steps did you follow ? This is still not working on my end. I just tried to clone the repo, made the changes mentioned in the the comments but still getting the same error.

ajean757 commented 2 months ago

Hi, I have the nerfstudio 1.1.3 installed, following the instructions on the quickstart page. As for pynerf, I followed the instructions on their github page. Are your issues related to pynerf-synthetic or is this the RayGenerator issue for pynerf?

GateraGael commented 2 months ago

Hello, the issue I am having is specifically with pynerf-synthetic for some reason. pynerf itself works without any issues. Did you simply pull the 1.1.3 image or did you build your own ?

ajean757 commented 2 months ago

Ah, I’m using WSL2 and installed nerfstudio from source.