search

MrForExample / ComfyUI-3D-Pack

An extensive node suite that enables ComfyUI to process 3D inputs (Mesh & UV Texture, etc) using cutting edge algorithms (3DGS, NeRF, etc.)
MIT License
2.41k stars 245 forks source link

Starting Convert 3DGS to Mesh with NeRF and Marching Cubes causes instant, logless crash in comfy UI #214

Open Duodecimus opened 4 months ago

Duodecimus commented 4 months ago

While trying Wonder3D_to_Large_Multiview_Gaussian_Model_to_3DGS and_3DMesh example workflow.

Previous steps finished completely fine, but as soon as the big mesh builder node is reached comfyui crashes. disabling the big node shows that the gaussian splat is produced correctly, as it is successfully saved.

Number of points at loading :  31928
[INFO] fitting nerf...
  0%|                                                                                         | 0/1024 [00:00<?, ?it/s]
C:\ImageAI\ComfyUI_windows_portable>pause
Press any key to continue . . .

No logs that I could find are produced by crashed instances.

ComfyUI environment:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:41:10_Pacific_Daylight_Time_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

Package                     Version
--------------------------- ------------------
accelerate                  0.32.1
aiohttp                     3.9.5
aiosignal                   1.3.1
annotated-types             0.7.0
antlr4-python3-runtime      4.9.3
anyio                       4.4.0
attrs                       23.2.0
audioread                   3.0.1
cachetools                  5.3.3
certifi                     2024.6.2
cffi                        1.16.0
charset-normalizer          3.3.2
click                       8.1.7
clip-interrogator           0.6.0
cmake                       3.30.0
color-matcher               0.5.0
colorama                    0.4.6
coloredlogs                 15.0.1
contourpy                   1.2.1
cryptography                42.0.8
cstr                        0.1.0
cycler                      0.12.1
dataclasses-json            0.6.7
ddt                         1.7.2
decorator                   5.1.1
Deprecated                  1.2.14
diff_gaussian_rasterization 0.0.0
diffusers                   0.29.2
distro                      1.9.0
docutils                    0.21.2
einops                      0.8.0
executing                   2.0.1
fairscale                   0.4.13
ffmpy                       0.3.0
filelock                    3.13.1
flatbuffers                 24.3.25
fonttools                   4.53.1
frozenlist                  1.4.1
fsspec                      2024.2.0
ftfy                        6.2.0
fvcore                      0.1.5.post20221221
gitdb                       4.0.11
GitPython                   3.1.43
h11                         0.14.0
httpcore                    1.0.5
httpx                       0.27.0
huggingface-hub             0.23.4
humanfriendly               10.0
idna                        3.7
imageio                     2.34.2
imageio-ffmpeg              0.5.1
img2texture                 1.0.6
importlib_metadata          8.0.0
intel-openmp                2021.4.0
iopath                      0.1.10
jaxtyping                   0.2.31
Jinja2                      3.1.3
joblib                      1.4.2
jsonschema                  4.23.0
jsonschema-specifications   2023.12.1
kiui                        0.2.10
kiwisolver                  1.4.5
kornia                      0.7.3
kornia_rs                   0.1.3
lazy_loader                 0.4
librosa                     0.10.2.post1
lightning-utilities         0.11.3.post0
llvmlite                    0.43.0
markdown-it-py              3.0.0
MarkupSafe                  2.1.5
marshmallow                 3.21.3
matplotlib                  3.9.1
matrix-client               0.4.0
mdurl                       0.1.2
mkl                         2021.4.0
mpmath                      1.3.0
msgpack                     1.0.8
msvc_runtime                14.40.33807
multidict                   6.0.5
mypy-extensions             1.0.0
nerfacc                     0.5.3
networkx                    3.2.1
ninja                       1.11.1.1
numba                       0.60.0
numpy                       1.26.3
nvdiffrast                  0.3.1
objprint                    0.2.3
omegaconf                   2.3.0
onnxruntime                 1.18.1
open_clip_torch             2.26.1
openai                      1.35.13
opencv-python               4.10.0.84
opencv-python-headless      4.7.0.72
packaging                   24.1
pandas                      2.2.2
piexif                      1.1.3
pilgram                     1.2.1
Pillow                      9.5.0
pip                         24.1.2
platformdirs                4.2.2
plyfile                     1.0.3
pointnet2_ops               3.0.0
pooch                       1.8.2
portalocker                 2.10.0
protobuf                    5.27.2
psutil                      6.0.0
py-cpuinfo                  9.0.0
pycparser                   2.22
pydantic                    2.8.2
pydantic_core               2.20.1
pygit2                      1.15.1
PyGithub                    2.3.0
pygltflib                   1.16.2
Pygments                    2.18.0
pyhocon                     0.3.61
PyJWT                       2.8.0
PyMatting                   1.1.12
PyMCubes                    0.1.6
pymeshlab                   2023.12.post1
PyNaCl                      1.5.0
pyparsing                   3.1.2
pyreadline3                 3.4.1
python-dateutil             2.9.0.post0
python-dotenv               1.0.1
pytorch-lightning           2.3.3
pytorch-msssim              1.0.0
pytorch3d                   0.7.7+pt2.3.0cu118
pytz                        2024.1
pywin32                     306
PyYAML                      6.0.1
referencing                 0.35.1
regex                       2024.5.15
rembg                       2.0.57
requests                    2.32.3
rich                        13.7.1
rpds-py                     0.19.0
safetensors                 0.4.3
scikit-image                0.24.0
scikit-learn                1.5.1
scipy                       1.14.0
seaborn                     0.13.2
segment-anything            1.0
setuptools                  70.1.1
shellingham                 1.5.4
simple_knn                  0.0.0
six                         1.16.0
smmap                       5.0.1
sniffio                     1.3.1
soundfile                   0.12.1
soxr                        0.3.7
spandrel                    0.3.4
sympy                       1.12
tabulate                    0.9.0
tbb                         2021.11.0
termcolor                   2.4.0
threadpoolctl               3.5.0
tifffile                    2024.7.2
timm                        1.0.7
tokenizers                  0.19.1
torch                       2.3.0+cu118
torch_scatter               2.1.2+pt23cu118
torchaudio                  2.3.1+cu118
torchmetrics                1.4.0.post0
torchsde                    0.2.6
torchtyping                 0.1.4
torchvision                 0.18.0+cu118
tqdm                        4.66.4
trampoline                  0.1.2
transformers                4.42.3
trimesh                     4.4.2
typeguard                   2.13.3
typer                       0.12.3
typing_extensions           4.9.0
typing-inspect              0.9.0
tzdata                      2024.1
ultralytics                 8.2.54
ultralytics-thop            2.0.0
urllib3                     1.26.19
varname                     0.13.1
wcwidth                     0.2.13
wheel                       0.43.0
wrapt                       1.16.0
xatlas                      0.0.9
xformers                    0.0.26.post1+cu118
yacs                        0.1.8
yarl                        1.9.4
zipp                        3.19.2

ComfyUI startup:

[START] Security scan
[DONE] Security scan
## ComfyUI-Manager: installing dependencies done.
** ComfyUI startup time: 2024-07-13 00:09:04.127616
** Platform: Windows
** Python version: 3.11.8 (tags/v3.11.8:db85d51, Feb  6 2024, 22:03:32) [MSC v.1937 64 bit (AMD64)]
** Python executable: C:\ImageAI\ComfyUI_windows_portable\python_embeded\python.exe
** ComfyUI Path: C:\ImageAI\ComfyUI_windows_portable\ComfyUI
** Log path: C:\ImageAI\ComfyUI_windows_portable\comfyui.log

Prestartup times for custom nodes:
   0.8 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manage

Total VRAM 4096 MB, total RAM 16005 MB
pytorch version: 2.3.0+cu118
xformers version: 0.0.26.post1+cu118
Set vram state to: LOW_VRAM
Device: cuda:0 NVIDIA GeForce RTX 3050 Laptop GPU : cudaMallocAsync
Using xformers cross attention
Warn!: xFormers is available (Attention)
Warn!: C:\ImageAI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils\cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(

### Loading: ComfyUI-Impact-Pack (V5.18.13)
### Loading: ComfyUI-Impact-Pack (Subpack: V0.6)
[Impact Pack] Wildcards loading done.
### Loading: ComfyUI-Inspire-Pack (V0.81)
Total VRAM 4096 MB, total RAM 16005 MB
pytorch version: 2.3.0+cu118
xformers version: 0.0.26.post1+cu118
Set vram state to: LOW_VRAM
Device: cuda:0 NVIDIA GeForce RTX 3050 Laptop GPU : cudaMallocAsync
### Loading: ComfyUI-Manager (V2.46.2)
### ComfyUI Revision: 2353 [ffe0bb0a] | Released on '2024-07-10'
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
WARNING: Could not find OPENAI_API_KEY in .env, disabling gpt prompt generation.
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
WAS Node Suite: OpenCV Python FFMPEG support is enabled
WAS Node Suite Warning: `ffmpeg_bin_path` is not set in `C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui\was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.
WAS Node Suite: Finished. Loaded 217 nodes successfully.

        "Challenges are what make life interesting and overcoming them is what makes life meaningful." - Joshua J. Marine

Import times for custom nodes:
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\pose-generator-comfyui-node
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Unload-Models
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-KJNodes
   0.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Inspire-Pack
   0.1 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite
   0.2 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
   0.4 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manage
   1.0 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui
   1.2 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\eden_comfy_pipelines
  18.1 seconds: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-3D-Pack

Starting server

To see the GUI go to: http://127.0.0.1:8188
FETCH DATA from: C:\ImageAI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manage\extension-node-map.json [DONE]
WorkSync commented 4 months ago

I meet the same problem.Could anybody help us?I wanna know the correct version of visual studio