Does it work for the model produced by nerfstudio?

[Jumpat]

Currently this code for SA3D only supports the provided nerf model. But in principle SA3D can support different kinds of NeRF.

[XinyueZ]

@Jumpat thank you. Would you mind showing me where the changes could be applied to the other NeRFs? I just want to ensure that the code is implemented effectively.

[Zanue]

Hi, we plan to integrate our SA3D model into nerfstudio in a few weeks. Currently the implementation of SA3D is not plug-in. To be applied to other NeRFs, it mainly needs a new 3D mask grid built over the pretrained NeRF and a new training pipeline to optimize the mask grid. You can compare run.py and run_seg_gui.py to find what changes are made.

[XinyueZ]

@Zanue Thank you for the reply. I would like to know if it is possible to use pre-trained models like nerfacto with SA3D. I have created a model using nerfacto and I want to fine-tune it using SA3D. I am unsure of where to start or if it is currently not possible. Do you have any suggestions? Thank you very much in advance.

[Zanue]

Thank you for your interest in our work! Currently SA3D cannot be directly applied to nerfacto, and we are planning to make nerfstudio support SA3D in a few weeks.

[FarahSaeed]

Hi

Just wanted to know... if it is integrated in nerfstudio by now. Thanks!

[Jumpat]

We have been trying, but it appears to be a hard work🤣. Thanks for your patience.

[FarahSaeed]

Thanks.

[XinyueZ]

But is it possible to let the SA3D support nerfacto in first? Just my opinion.

[Jumpat]

This is exactly what we are working on now!👍

[XinyueZ]

OK, I am really looking forwards to the support of nerfacto.

[RonnyVelastegui2018]

Hi,

Just wanted to know if it is integrated with nerfstudio already :)

Thanks!

[Zanue]

We have released the nerfstudio-version SA3D in the branch nerfstudio-version. Currently it only supports text prompts as input. Feel free to ask questions!