thiagodma
commented
2 years ago Hey @YJYJLee , can you tell me how did you manage to install Minkowski Engine? I just can't install it anyway I try
Open YJYJLee opened 2 years ago
thiagodma
commented
2 years ago Hey @YJYJLee , can you tell me how did you manage to install Minkowski Engine? I just can't install it anyway I try
SFMDI
commented
2 years ago setup.py develop and pip install -e give me the same error "error: could not create 'MinkowskiEngineBackend/_C.cpython-38-x86_64-linux-gnu.so': No such file or directory"
vardeep-sandhu
commented
2 years ago Hey I am facing the exact same error. Anyone got a clue how to solve this?
thiagodma
commented
2 years ago This dockerfile works for me.
FROM pytorch/pytorch:1.9.1-cuda11.1-cudnn8-devel
WORKDIR /app
##############################################
# You should modify this to match your GPU compute capability
# https://developer.nvidia.com/cuda-gpus#compute
ENV TORCH_CUDA_ARCH_LIST="8.6"
##############################################
ENV TORCH_NVCC_FLAGS="-Xfatbin -compress-all"
ENV CUDA_HOME=/usr/local/cuda-11.1
ENV MAX_JOBS=1
# Install dependencies
RUN apt-get update
RUN apt-get install -y git ninja-build cmake build-essential libopenblas-dev \
xterm xauth openssh-server tmux wget mate-desktop-environment-core
RUN apt-get clean
RUN rm -rf /var/lib/apt/lists/*
# activate base conda env
SHELL ["conda", "run", "-n", "base", "/bin/bash", "-c"]
RUN pip install -U git+https://github.com/NVIDIA/MinkowskiEngine -v --no-deps --install-option="--force_cuda" --install-option="--blas=openblas"
samanemami
commented
1 year ago This dockerfile works for me.
FROM pytorch/pytorch:1.9.1-cuda11.1-cudnn8-devel WORKDIR /app ############################################## # You should modify this to match your GPU compute capability # https://developer.nvidia.com/cuda-gpus#compute ENV TORCH_CUDA_ARCH_LIST="8.6" ############################################## ENV TORCH_NVCC_FLAGS="-Xfatbin -compress-all" ENV CUDA_HOME=/usr/local/cuda-11.1 ENV MAX_JOBS=1 # Install dependencies RUN apt-get update RUN apt-get install -y git ninja-build cmake build-essential libopenblas-dev \ xterm xauth openssh-server tmux wget mate-desktop-environment-core RUN apt-get clean RUN rm -rf /var/lib/apt/lists/* # activate base conda env SHELL ["conda", "run", "-n", "base", "/bin/bash", "-c"] RUN pip install -U git+https://github.com/NVIDIA/MinkowskiEngine -v --no-deps --install-option="--force_cuda" --install-option="--blas=openblas"
Could you please explain how did you run it? Thank you
Kipsora
commented
1 year ago So for everyone who noticed this issue, just creating an empty folder called MinkowskiEngineBackend under the repo root and then doing another pip install -e works for me. I guess the issue caused by that pip will not create the folder for the built extension by default.
kaoutar-elmouh
commented
4 weeks ago Donc, pour tous ceux qui ont remarqué ce problème, il suffit de créer un dossier vide appelé
MinkowskiEngineBackendsous la racine du dépôt, puis d'effectuer un autre pip install -e qui fonctionne pour moi. Je suppose que le problème causé par ce pip ne créera pas le dossier pour l'extension construite par défaut.
can you explain more please?
Kipsora
commented
4 weeks ago Donc, pour tous ceux qui ont remarqué ce problème, il suffit de créer un dossier vide appelé
MinkowskiEngineBackendsous la racine du dépôt, puis d'effectuer un autre pip install -e qui fonctionne pour moi. Je suppose que le problème causé par ce pip ne créera pas le dossier pour l'extension construite par défaut.can you explain more please?
What I meant is that you could just create an empty folder under the repo, and that will resolve this issue.
Like:
git clone https://github.com/NVIDIA/MinkowskiEngine.git
cd MinkowskiEngine
mkdir MinkowskiEngineBackend
pip3 install -e .And why pip will fail is because it cannot find the folder MinkowskiEngineBackend, so creating it manually will resolve the issue.
kaoutar-elmouh
commented
4 weeks ago Donc, pour tous ceux qui ont remarqué ce problème, il suffit de créer un dossier vide appelé
MinkowskiEngineBackendsous la racine du dépôt, puis d'effectuer un autre pip install -e qui fonctionne pour moi. Je suppose que le problème provoqué par ce pip ne créera pas le dossier pour l'extension construite par défaut.pouvez-vous expliquer davantage s'il vous plaît ?
Ce que je voulais dire, c'est que vous pouvez simplement créer un dossier vide sous le dépôt, et cela résoudra ce problème.
Comme:
git clone https://github.com/NVIDIA/MinkowskiEngine.git cd MinkowskiEngine mkdir MinkowskiEngineBackend pip3 install -e .Et la raison
pipde l'échec est qu'il ne parvient pas à trouver le dossierMinkowskiEngineBackend. Par conséquent, sa création manuelle résoudra le problème.
Thank you for the quick response. I am trying your solution but it doesn't work for me on GPU. Here is the error:
/content/MinkowskiEngine ['Obtaining file:///content/MinkowskiEngine', ' Preparing metadata (setup.py) ... \x1b[?25l\x1b[?25hdone', 'Requirement already satisfied: torch in /usr/local/lib/python3.10/dist-packages (from MinkowskiEngine==0.5.4) (2.3.0+cu121)', 'Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from MinkowskiEngine==0.5.4) (1.25.2)', 'Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (3.14.0)', 'Requirement already satisfied: typing-extensions>=4.8.0 in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (4.12.1)', 'Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (1.12.1)', 'Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (3.3)', 'Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (3.1.4)', 'Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (2023.6.0)', 'Collecting nvidia-cuda-nvrtc-cu12==12.1.105 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (23.7 MB)', 'Collecting nvidia-cuda-runtime-cu12==12.1.105 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (823 kB)', 'Collecting nvidia-cuda-cupti-cu12==12.1.105 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (14.1 MB)', 'Collecting nvidia-cudnn-cu12==8.9.2.26 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl (731.7 MB)', 'Collecting nvidia-cublas-cu12==12.1.3.1 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl (410.6 MB)', 'Collecting nvidia-cufft-cu12==11.0.2.54 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl (121.6 MB)', 'Collecting nvidia-curand-cu12==10.3.2.106 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl (56.5 MB)', 'Collecting nvidia-cusolver-cu12==11.4.5.107 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl (124.2 MB)', 'Collecting nvidia-cusparse-cu12==12.1.0.106 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl (196.0 MB)', 'Collecting nvidia-nccl-cu12==2.20.5 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_nccl_cu12-2.20.5-py3-none-manylinux2014_x86_64.whl (176.2 MB)', 'Collecting nvidia-nvtx-cu12==12.1.105 (from torch->MinkowskiEngine==0.5.4)', ' Using cached nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (99 kB)', 'Requirement already satisfied: triton==2.3.0 in /usr/local/lib/python3.10/dist-packages (from torch->MinkowskiEngine==0.5.4) (2.3.0)', 'Collecting nvidia-nvjitlink-cu12 (from nvidia-cusolver-cu12==11.4.5.107->torch->MinkowskiEngine==0.5.4)', ' Downloading nvidia_nvjitlink_cu12-12.5.40-py3-none-manylinux2014_x86_64.whl (21.3 MB)', '\x1b[?25l \x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m0.0/21.3 MB\x1b[0m \x1b[31m?\x1b[0m eta \x1b[36m-:--:--\x1b[0m', '\x1b[2K \x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m0.3/21.3 MB\x1b[0m \x1b[31m8.0 MB/s\x1b[0m eta \x1b[36m0:00:03\x1b[0m', '\x1b[2K \x1b[91m━\x1b[0m\x1b[90m╺\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m0.7/21.3 MB\x1b[0m \x1b[31m10.5 MB/s\x1b[0m eta \x1b[36m0:00:02\x1b[0m', '\x1b[2K \x1b[91m━━\x1b[0m\x1b[90m╺\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m1.3/21.3 MB\x1b[0m \x1b[31m12.6 MB/s\x1b[0m eta \x1b[36m0:00:02\x1b[0m', '\x1b[2K \x1b[91m━━━\x1b[0m\x1b[91m╸\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m2.1/21.3 MB\x1b[0m \x1b[31m14.9 MB/s\x1b[0m eta \x1b[36m0:00:02\x1b[0m', '\x1b[2K \x1b[91m━━━━━\x1b[0m\x1b[91m╸\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m3.0/21.3 MB\x1b[0m \x1b[31m17.4 MB/s\x1b[0m eta \x1b[36m0:00:02\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━\x1b[0m\x1b[90m╺\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m4.4/21.3 MB\x1b[0m \x1b[31m20.9 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━\x1b[0m\x1b[90m╺\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m6.1/21.3 MB\x1b[0m \x1b[31m24.8 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━\x1b[0m\x1b[91m╸\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m8.4/21.3 MB\x1b[0m \x1b[31m29.8 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━━━━━━━\x1b[0m\x1b[91m╸\x1b[0m\x1b[90m━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m11.5/21.3 MB\x1b[0m \x1b[31m47.4 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m\x1b[90m╺\x1b[0m\x1b[90m━━━━━━━━━━\x1b[0m \x1b[32m15.6/21.3 MB\x1b[0m \x1b[31m86.1 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m\x1b[90m╺\x1b[0m \x1b[32m21.0/21.3 MB\x1b[0m \x1b[31m131.9 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m\x1b[91m╸\x1b[0m \x1b[32m21.3/21.3 MB\x1b[0m \x1b[31m131.6 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[91m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m\x1b[91m╸\x1b[0m \x1b[32m21.3/21.3 MB\x1b[0m \x1b[31m131.6 MB/s\x1b[0m eta \x1b[36m0:00:01\x1b[0m', '\x1b[2K \x1b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\x1b[0m \x1b[32m21.3/21.3 MB\x1b[0m \x1b[31m60.8 MB/s\x1b[0m eta \x1b[36m0:00:00\x1b[0m', '\x1b[?25hRequirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch->MinkowskiEngine==0.5.4) (2.1.5)', 'Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /usr/local/lib/python3.10/dist-packages (from sympy->torch->MinkowskiEngine==0.5.4) (1.3.0)', 'Installing collected packages: nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia-nccl-cu12, nvidia-curand-cu12, nvidia-cufft-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, nvidia-cusparse-cu12, nvidia-cudnn-cu12, nvidia-cusolver-cu12, MinkowskiEngine', ' Running setup.py develop for MinkowskiEngine', ' \x1b[1;31merror\x1b[0m: \x1b[1msubprocess-exited-with-error\x1b[0m', ' ', ' \x1b[31m×\x1b[0m \x1b[32mpython setup.py develop\x1b[0m did not run successfully.', ' \x1b[31m│\x1b[0m exit code: \x1b[1;36m1\x1b[0m', ' \x1b[31m╰─>\x1b[0m See above for output.', ' ', ' \x1b[1;35mnote\x1b[0m: This error originates from a subprocess, and is likely not a problem with pip.', '\x1b[1;31merror\x1b[0m: \x1b[1msubprocess-exited-with-error\x1b[0m', '', '\x1b[31m×\x1b[0m \x1b[32mpython setup.py develop\x1b[0m did not run successfully.', '\x1b[31m│\x1b[0m exit code: \x1b[1;36m1\x1b[0m', '\x1b[31m╰─>\x1b[0m See above for output.', '', '\x1b[1;35mnote\x1b[0m: This error originates from a subprocess, and is likely not a problem with pip.']
Hi, I am trying to build MinkowskiEngine@v0.5.4 as develop mode for the research purpose. I tried the command
python setup.py installand succeed in installing it and checked MinkowskiEngine being well imported.However, when I try installing in editable mode with the command
pip install --editable ., I keep getting the following error.I checked there exists
MinkowskiEngineBackend/_C.cpython-38-x86_64-linux-gnu.soin the build directory. I followed instruction in README.md using conda environment. Below is the result of running commandwget -q https://raw.githubusercontent.com/NVIDIA/MinkowskiEngine/master/MinkowskiEngine/diagnostics.py ; python diagnostics.pyCould you give me some help with it?