search

threestudio-project / threestudio

A unified framework for 3D content generation.
Apache License 2.0
5.91k stars 457 forks source link

How to export the scene generated by "prolificdreamer-scene.yaml" to a 3D mesh format? #329

Open caojiehui opened 8 months ago

caojiehui commented 8 months ago

We use the following command to convert the scene into a 3D mesh format:

config_path=/home/yingjie/threestudio/outputs/prolificdreamer/Golden_rainwater_in_a_fantastical_weather,_realistic_detailed_photo,_4k@20231023-110627/configs/parsed.yaml
resume_path=/home/yingjie/threestudio/outputs/prolificdreamer/Golden_rainwater_in_a_fantastical_weather,_realistic_detailed_photo,_4k@20231023-110627/ckpts/last.ckpt

CUDA_VISIBLE_DEVICES=9 python launch.py --config $config_path --export resume=$resume_path system.exporter_type=mesh-exporter system.exporter.context_type=cuda system.geometry.isosurface_threshold=10.

The generated MP4 video results are excellent, but when using the above command to convert them into 3D mesh, the results are as shown in the following image:

WechatIMG406

Is there an issue with the command for converting to 3D mesh mentioned above? How should we modify it to generate 3D mesh data corresponding to the video in MP4 format?

DSaurus commented 7 months ago

Hi @caojiehui ,

Currently, ThreeStudio is unable to export a 360-degree scene as a 3D mesh. I think implementing additional representations, such as a skybox, would enable us to achieve that.

v4r4rth commented 4 months ago

Is there any way to export the generated scene as an HDR file? Would like to see if it is possible to break the monopoly (blockade labs) on 3D world generation!