threestudio-project / threestudio

A unified framework for 3D content generation.
Apache License 2.0
6.17k stars 475 forks source link

train zero123 yields rotating video but export has no vertices and faces #421

Closed createthis closed 8 months ago

createthis commented 8 months ago

I have a very simple pixel art sprite image from an old 2d game project: walking1

I successfully created the 3d rotating video using zero123:

python launch.py --config configs/stable-zero123.yaml --train --gpu 0 data.image_path=./load/images/walking1.png

https://github.com/threestudio-project/threestudio/assets/1695880/9e45f33b-9469-40b1-8dde-eb75ee81b5a6

However, when I try to export the mesh:

python launch.py --config configs/stable-zero123.yaml --export --verbose --gpu 0 data.image_path=./load/images/walking1.png system.exporter_type=mesh-exporter

... it doesn't seem to think the mesh has vertices or faces:

threestudio_no_faces

I'm on Windows 10 and I'm using a 3090 RTX. Python 3.10.11 pip 23.3.2 from C:\Users\jesse\Documents\ai\threestudio\venv\lib\site-packages\pip (python 3.10)

Compiling nvdiffrast_plugin and getting it to work, such as it is, was a challenge:

Anyway, please let me know if you have any ideas for further debugging.

createthis commented 8 months ago

nvm, this was user error. I failed to read the instructions and used data.image_path instead of resume. Here's the updated working command:

python launch.py --config configs/stable-zero123.yaml --export --gpu 0 resume=outputs/zero123-sai/\[64\,\ 128\,\ 256\]_walking1.png\@20240126-111928/ckpts/last.ckpt system.exporter_type=mesh-exporter

Here's the object in Blender: walking_blender

Very cool stuff! Closing!