search

cvachha / instruct-gs2gs

Gaussian splatting implementation of Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
https://instruct-gs2gs.github.io/
MIT License
62 stars 1 forks source link

Connection error instruct-pix2pix #7

Closed 2629630207 closed 6 months ago

2629630207 commented 6 months ago

I use [ns-train igs2gs --data ./poster --load-dir ./outputs/poster/nerfacto/2024-02-20_172727/nerfstudio_models --pipeline.prompt "a chair" --pipeline.guidance-scale 12.5 --pipeline.image-guidance-scale 1.5 ] and the error is ~N$2`OP_PWAVF$30@HW{U9N I konw there is something wrong with my net, so it means that I should pre-install instruct-pix2pix from https://huggingface.co/timbrooks/instruct-pix2pix to avoid this?

ayaanzhaque commented 6 months ago

Ya maybe. Seems like some huggingface issue, so maybe search on those forums to find a solution.

2629630207 commented 6 months ago

Ya maybe. Seems like some huggingface issue, so maybe search on those forums to find a solution.

Thank you for your suggestion. I download pix2pix,v1-4 and v1-5 and it runs. However, another error occurs when loading the checkpoints. UJ12}XNHMR416QLFQ{T{U80 Could you please offer me some advice?

ayaanzhaque commented 6 months ago

Seems like some weird issue with loading the pre-trained GS. @cvachha any ideas here?

cvachha commented 6 months ago

Hi, @2629630207 I'm not exactly sure why this issue is occurring. If the GS you are editing was trained before the Nerfstudio V1,0 release, that might cause this issue. I would recommend to try re-training the initial GS with splatfacto and then running igs2gs, but I'm not sure why loading a checkpoint is giving this error. If you load a splatfacto checkpoint with ns-train splatfacto (without running igs2gs) does this error still occur?

2629630207 commented 6 months ago

Hi, @2629630207 I'm not exactly sure why this issue is occurring. If the GS you are editing was trained before the Nerfstudio V1,0 release, that might cause this issue. I would recommend to try re-training the initial GS with splatfacto and then running igs2gs, but I'm not sure why loading a checkpoint is giving this error. If you load a splatfacto checkpoint with ns-train splatfacto (without running igs2gs) does this error still occur?

Thank you for your reply.I try splatfacto and runn igs2gs, it works. 20240223101810

So I believe it's likely a version issue of Nerfstudio as you say. I will check the version. Expressing my gratitude once again.