nv-tlabs / XCube

[CVPR 2024 Highlight] XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies
https://research.nvidia.com/labs/toronto-ai/xcube/
Other
344 stars 20 forks source link

How do I build fvdb on Jetson? #17

Open chgarner opened 4 months ago

chgarner commented 4 months ago

I am trying to get xcube to run on a nvidia Jetson Orin Nano. It is currently running with Jetpack 6.0.

During the setup process I ran into an error while building fvdb with 'python setup.py develop.' The error messages are below.

Do I have to modify the setup.py file to work properly with the jetson? Also will I have to modify the setup.py for building nksr afterwards?

home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libc10.so when searching for -lc10 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lc10: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libc10.so when searching for -lc10 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch.so when searching for -ltorch /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -ltorch: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch.so when searching for -ltorch /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so when searching for -ltorch_cpu /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -ltorch_cpu: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so when searching for -ltorch_cpu /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_python.so when searching for -ltorch_python /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -ltorch_python: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_python.so when searching for -ltorch_python /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lcudart: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../lib/libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../libcudart.so when searching for -lcudart /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libc10_cuda.so when searching for -lc10_cuda /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lc10_cuda: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libc10_cuda.so when searching for -lc10_cuda /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so when searching for -ltorch_cuda /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -ltorch_cuda: No such file or directory /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so when searching for -ltorch_cuda /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libstdc++.so when searching for -lstdc++ /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libstdc++.so when searching for -lstdc++ /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libstdc++.so when searching for -lstdc++ /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libstdc++.so when searching for -lstdc++ /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libgcc_s.so.1 when searching for libgcc_s.so.1 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libgcc_s.so.1 when searching for libgcc_s.so.1 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libgcc_s.so.1 when searching for libgcc_s.so.1 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libgcc_s.so.1 when searching for libgcc_s.so.1 /home/kri/anaconda3/envs/xcube/bin/../lib/gcc/x86_64-conda-linux-gnu/11.4.0/../../../../x86_64-conda-linux-gnu/bin/ld: skipping incompatible /home/kri/anaconda3/envs/xcube/lib/libgcc_s.so.1 when searching for libgcc_s.so.1 collect2: error: ld returned 1 exit status error: command '/home/kri/anaconda3/envs/xcube/bin/x86_64-conda-linux-gnu-c++' failed with exit code 1

NinaWie commented 3 months ago

I also have trouble installing fvdb, with a similar output when running pip install . . It looks like an oom error, but occurs even when running it on a 48 GB gpu.

[1/53] .. 
...
[52/53] /home/nwiedema/miniforge3/envs/xcube/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/convolution/backend/SparseConvolutionCutlass.o.d -I/home/nwiedema/XCube/openvdb/fvdb/src -I/home/nwiedema/XCube/openvdb/fvdb/../nanovdb -I/home/nwiedema/XCube/openvdb/fvdb/external/cutlass/include -I/home/nwiedema/XCube/openvdb/fvdb/external/c-blosc/install/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn_fe/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn/cudnn-linux-x86_64-9.1.0.70_cuda12-archive/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/TH -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/THC -I/home/nwiedema/miniforge3/envs/xcube/include -I/home/nwiedema/miniforge3/envs/xcube/include/python3.10 -c -c /home/nwiedema/XCube/openvdb/fvdb/src/detail/ops/convolution/backend/SparseConvolutionCutlass.cu -o /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/convolution/backend/SparseConvolutionCutlass.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++20 --extended-lambda --diag-suppress=186 -diag-suppress=3189 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fvdblib -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -ccbin /usr/bin/gcc-11
    FAILED: /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/convolution/backend/SparseConvolutionCutlass.o
    /home/nwiedema/miniforge3/envs/xcube/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/convolution/backend/SparseConvolutionCutlass.o.d -I/home/nwiedema/XCube/openvdb/fvdb/src -I/home/nwiedema/XCube/openvdb/fvdb/../nanovdb -I/home/nwiedema/XCube/openvdb/fvdb/external/cutlass/include -I/home/nwiedema/XCube/openvdb/fvdb/external/c-blosc/install/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn_fe/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn/cudnn-linux-x86_64-9.1.0.70_cuda12-archive/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/TH -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/THC -I/home/nwiedema/miniforge3/envs/xcube/include -I/home/nwiedema/miniforge3/envs/xcube/include/python3.10 -c -c /home/nwiedema/XCube/openvdb/fvdb/src/detail/ops/convolution/backend/SparseConvolutionCutlass.cu -o /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/convolution/backend/SparseConvolutionCutlass.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++20 --extended-lambda --diag-suppress=186 -diag-suppress=3189 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fvdblib -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -ccbin /usr/bin/gcc-11
    Killed
    [53/53] /home/nwiedema/miniforge3/envs/xcube/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/PaddedIJKForMesh.o.d -I/home/nwiedema/XCube/openvdb/fvdb/src -I/home/nwiedema/XCube/openvdb/fvdb/../nanovdb -I/home/nwiedema/XCube/openvdb/fvdb/external/cutlass/include -I/home/nwiedema/XCube/openvdb/fvdb/external/c-blosc/install/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn_fe/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn/cudnn-linux-x86_64-9.1.0.70_cuda12-archive/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/TH -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/THC -I/home/nwiedema/miniforge3/envs/xcube/include -I/home/nwiedema/miniforge3/envs/xcube/include/python3.10 -c -c /home/nwiedema/XCube/openvdb/fvdb/src/detail/ops/PaddedIJKForMesh.cu -o /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/ops/PaddedIJKForMesh.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++20 --extended-lambda --diag-suppress=186 -diag-suppress=3189 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fvdblib -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -ccbin /usr/bin/gcc-11
    ninja: build stopped: subcommand failed.
    [end of output]

I also tried with other GCC already, didn't help. Did you find a solution @chgarner ?

xrenaa commented 3 months ago

Hi @NinaWie, I think there should not be oom error for installing fvdb. Could you try python setup.py develop again?

NinaWie commented 3 months ago

Thanks for your help @xrenaa . I pulled the latest version of fvdb and tried again, but have the same issue. It happens when building the fvdb.fvdblib extension. I'm using Python 3.10, torch 2.2.0, cuda 12.1 (as installed with the environment.yaml) The output where the error occurs is the following:

building 'fvdb.fvdblib' extension
Emitting ninja build file /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
Killed
[1/81] /home/nwiedema/miniforge3/envs/xcube/bin/x86_64-conda-linux-gnu-c++ -MMD -MF /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/build/FineFromCoarse.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -fPIC -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/nwiedema/miniforge3/envs/xcube/include -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -fPIC -I/home/nwiedema/XCube/openvdb/fvdb/src -I/home/nwiedema/XCube/openvdb/fvdb/../nanovdb -I/home/nwiedema/XCube/openvdb/fvdb/external/cutlass/include -I/home/nwiedema/XCube/openvdb/fvdb/external/c-blosc/install/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn_fe/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn/cudnn-linux-x86_64-9.1.0.70_cuda12-archive/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/TH -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/THC -I/home/nwiedema/miniforge3/envs/xcube/include -I/home/nwiedema/miniforge3/envs/xcube/include/python3.10 -c -c /home/nwiedema/XCube/openvdb/fvdb/src/detail/build/FineFromCoarse.cpp -o /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/build/FineFromCoarse.o -std=c++20 -Wno-unknown-pragmas -Wno-class-memaccess -fdiagnostics-color=always -DNANOVDB_USE_BLOSC -fvisibility=default -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fvdblib -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/build/FineFromCoarse.o 
/home/nwiedema/miniforge3/envs/xcube/bin/x86_64-conda-linux-gnu-c++ -MMD -MF /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/build/FineFromCoarse.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -fPIC -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/nwiedema/miniforge3/envs/xcube/include -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /home/nwiedema/miniforge3/envs/xcube/include -fPIC -I/home/nwiedema/XCube/openvdb/fvdb/src -I/home/nwiedema/XCube/openvdb/fvdb/../nanovdb -I/home/nwiedema/XCube/openvdb/fvdb/external/cutlass/include -I/home/nwiedema/XCube/openvdb/fvdb/external/c-blosc/install/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn_fe/include -I/home/nwiedema/XCube/openvdb/fvdb/external/cudnn/cudnn-linux-x86_64-9.1.0.70_cuda12-archive/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/TH -I/home/nwiedema/miniforge3/envs/xcube/lib/python3.10/site-packages/torch/include/THC -I/home/nwiedema/miniforge3/envs/xcube/include -I/home/nwiedema/miniforge3/envs/xcube/include/python3.10 -c -c /home/nwiedema/XCube/openvdb/fvdb/src/detail/build/FineFromCoarse.cpp -o /home/nwiedema/XCube/openvdb/fvdb/build/temp.linux-x86_64-cpython-310/src/detail/build/FineFromCoarse.o -std=c++20 -Wno-unknown-pragmas -Wno-class-memaccess -fdiagnostics-color=always -DNANOVDB_USE_BLOSC -fvisibility=default -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fvdblib -D_GLIBCXX_USE_CXX11_ABI=0
x86_64-conda-linux-gnu-c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
xrenaa commented 3 months ago

Hi @NinaWie, please try: export MAX_JOBS=$(free -g | awk '/^Mem:/{jobs=int($4/2.5); if(jobs<1) jobs=1; print jobs}') before you install fvdb. This should be an issue of cpu memory.

NinaWie commented 3 months ago

Thanks a lot for your help. It actually only worked after increasing the requested number of CPUs on our cluster significantly, but is installed now!

KokeCacao commented 3 months ago

Hi @NinaWie, please try: export MAX_JOBS=$(free -g | awk '/^Mem:/{jobs=int($4/2.5); if(jobs<1) jobs=1; print jobs}') before you install fvdb. This should be an issue of cpu memory.

Yah... It forces me to add 300GB of swap on my 16GB memory machine. LOL