Is there a simple way to port Threestudio's output to Nerfstudio viewer?

threestudio-project / threestudio

A unified framework for 3D content generation.

Apache License 2.0

5.97k stars 461 forks source link

Is there a simple way to port Threestudio's output to Nerfstudio viewer? #342

Open ThibaultGROUEIX opened 8 months ago

ThibaultGROUEIX commented 8 months ago

Thanks again for the awesome repo

For instance, I'd like to generate a shape with prolific dreamer (instant-ngp) and view/manipulate it in threestudio : https://github.com/nerfstudio-project/nerfstudio/blob/main/nerfstudio/models/instant_ngp.py#L52. Is there a way to achieve this?

Thank you ! Thibault

DSaurus commented 7 months ago

Hi @ThibaultGROUEIX ,

Currently, we don't have this interface. A feasible solution is to export the rendered images and camera parameters of the prolific dreamer. In this way, you can re-optimize them with nerfstudio and display them in its viewer.

We are developing a plugin system that will be able to support this feature in the future.