search

nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs
https://docs.nerf.studio
Apache License 2.0
9.58k stars 1.31k forks source link

running semantic-nerfw on custom data #1275

Open Mehi44 opened 1 year ago

Mehi44 commented 1 year ago

Has anyone been able to generate the same data format required for semantic-nerfw from their own dataset ?

yimingzhou1 commented 1 year ago

I have the same question. Also the result of running semantic-nerfw on friends dataset using default settings doesn't look good.

cezarbbb commented 1 year ago

Has anyone been able to generate the same data format required for semantic-nerfw from their own dataset ?

I want to know how to generate cameras.json?

ethanweber commented 1 year ago

If you are interested in creating something with cameras.json format, you can reference this code and [this notebook](this notebook).

We recommend using nerfstudio if you want to do anything custom with semantics. You can copy the nerfstudio dataparser and then modify it to add semantics, like we do here.

ethanweber commented 1 year ago

I have the same question. Also the result of running semantic-nerfw on friends dataset using default settings doesn't look good.

I don't expect the results to look good until transient embeddings from NeRF-W are implemented. If you are interested in working on this and making a PR, you could reference nerf_pl.

AlexanderVoldby commented 9 months ago

Question to the participants in this discussion: Have any of you had succes with creating custom datasets for semantic_nerfw? If so would you be willing to share some knowledge with me? I am currently working on a project where this woud be very useful