Open Gaohhy opened 5 months ago
When I run neus for 3D reconstruction, I get the following error, how can I fix it? Epoch 0: : 1999it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.64e-5, rendering=0.393, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2000it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.64e-5, rendering=0.393, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2000it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.56e-5, rendering=0.397, mask=6.8e-7, step=2e+3, lr=7.07 Epoch 0: : 2001it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.56e-5, rendering=0.397, mask=6.8e-7, step=2e+3, lr=7.07 Epoch 0: : 2001it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=1.84e-5, rendering=0.397, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2002it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.84e-5, rendering=0.397, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2002it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.88e-5, rendering=0.396, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2003it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.88e-5, rendering=0.396, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2003it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.07e-5] Trainer.fit stopped: max_steps=2000 reached. Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.07e-5] 100%|████████████████████████████████████████████████████████████████████████████████████| 180/180 [08:58<00:00, 2.99s/it] Traceback (most recent call last): File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 187, in main() File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 184, in main extract_mesh(model, log_dir) File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 113, in extract_mesh vertices, triangles, vertex_colors = extract_geometry(bbox_min, bbox_max, resolution, 0, lambda x: model.renderer.sdf_network.sdf(x), lambda x: model.renderer.get_vertex_colors(x)) File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 105, in extract_geometry vertex_colors = color_func(vertices) File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 113, in vertices, triangles, vertex_colors = extract_geometry(bbox_min, bbox_max, resolution, 0, lambda x: model.renderer.sdf_network.sdf(x), lambda x: model.renderer.get_vertex_colors(x)) File "/home/boss_lu/miniconda3/envs/zero123/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, *kwargs) File "/home/boss_lu/ghy/SyncDreamer-main/renderer/renderer.py", line 162, in get_vertex_colors verts_colors = (np.concatenate(verts_colors, 0)255).astype(np.uint8) File "<__array_function__ internals>", line 200, in concatenate ValueError: need at least one array to concatenate
Trainer.fit
max_steps=2000
When I run neus for 3D reconstruction, I get the following error, how can I fix it? Epoch 0: : 1999it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.64e-5, rendering=0.393, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2000it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.64e-5, rendering=0.393, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2000it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.56e-5, rendering=0.397, mask=6.8e-7, step=2e+3, lr=7.07 Epoch 0: : 2001it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=2.56e-5, rendering=0.397, mask=6.8e-7, step=2e+3, lr=7.07 Epoch 0: : 2001it [15:05, 2.21it/s, loss=0.201, v_num=0, eikonal=1.84e-5, rendering=0.397, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2002it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.84e-5, rendering=0.397, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2002it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.88e-5, rendering=0.396, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2003it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=1.88e-5, rendering=0.396, mask=6.66e-7, step=2e+3, lr=7.0 Epoch 0: : 2003it [15:06, 2.21it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.0 Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.07e-5]
main()
File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 184, in main
extract_mesh(model, log_dir)
File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 113, in extract_mesh
vertices, triangles, vertex_colors = extract_geometry(bbox_min, bbox_max, resolution, 0, lambda x: model.renderer.sdf_network.sdf(x), lambda x: model.renderer.get_vertex_colors(x))
File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 105, in extract_geometry
vertex_colors = color_func(vertices)
File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 113, in
vertices, triangles, vertex_colors = extract_geometry(bbox_min, bbox_max, resolution, 0, lambda x: model.renderer.sdf_network.sdf(x), lambda x: model.renderer.get_vertex_colors(x))
File "/home/boss_lu/miniconda3/envs/zero123/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, *kwargs)
File "/home/boss_lu/ghy/SyncDreamer-main/renderer/renderer.py", line 162, in get_vertex_colors
verts_colors = (np.concatenate(verts_colors, 0)255).astype(np.uint8)
File "<__array_function__ internals>", line 200, in concatenate
ValueError: need at least one array to concatenate
Trainer.fit
stopped:max_steps=2000
reached. Epoch 0: : 2004it [15:10, 2.20it/s, loss=0.201, v_num=0, eikonal=2.32e-5, rendering=0.412, mask=6.65e-7, step=2e+3, lr=7.07e-5] 100%|████████████████████████████████████████████████████████████████████████████████████| 180/180 [08:58<00:00, 2.99s/it] Traceback (most recent call last): File "/home/boss_lu/ghy/SyncDreamer-main/train_renderer.py", line 187, in