src-d / kmcuda

Large scale K-means and K-nn implementation on NVIDIA GPU / CUDA
Other
806 stars 145 forks source link

Can't Install in Google Colab #105

Closed DevashishX closed 4 years ago

DevashishX commented 4 years ago

How to install properly in google colab: !export CUDA_TOOLKIT_ROOT_DIR='/usr/local/cuda'; export CUDA_ARCH=75; export DISABLE_R='y';pip install libKMCUDA Solved ✅

HI, I am trying to use this lib on google colab with gpu support and it's not getting installed

the outputs of nvidia smi and nvcc --version are:

nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2019 NVIDIA Corporation Built on Sun_Jul_28_19:07:16_PDT_2019 Cuda compilation tools, release 10.1, V10.1.243 Fri Apr 17 09:27:52 2020
+-----------------------------------------------------------------------------+ | NVIDIA-SMI 440.64.00 Driver Version: 418.67 CUDA Version: 10.1 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Tesla P100-PCIE... Off | 00000000:00:04.0 Off | 0 | | N/A 35C P0 26W / 250W | 0MiB / 16280MiB | 0% Default | +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+

after running: !which python3 !CUDA_ARCH=70 pip install 'git+https://github.com/src-d/kmcuda.git#subdirectory=src'

I get this output:

/usr/bin/python3 Collecting git+https://github.com/src-d/kmcuda.git#subdirectory=src Cloning https://github.com/src-d/kmcuda.git to /tmp/pip-req-build-e3byybnp Running command git clone -q https://github.com/src-d/kmcuda.git /tmp/pip-req-build-e3byybnp Requirement already satisfied: numpy in /usr/local/lib/python3.6/dist-packages (from libKMCUDA==6.2.3) (1.18.2) Building wheels for collected packages: libKMCUDA Building wheel for libKMCUDA (setup.py) ... error ERROR: Failed building wheel for libKMCUDA Running setup.py clean for libKMCUDA Failed to build libKMCUDA Installing collected packages: libKMCUDA Running setup.py install for libKMCUDA ... error ERROR: Command errored out with exit status 1: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-e3byybnp/src/setup.py'"'"'; file='"'"'/tmp/pip-req-build-e3byybnp/src/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-r6zfk4g6/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.

any solutions?

DevashishX commented 4 years ago

!git clone https://github.com/src-d/kmcuda; export CUDA_TOOLKIT_ROOT_DIR='/usr/local/cuda'; cd kmcuda/src && python setup.py install

above code for colab installs the module

installation output - running install running bdist_egg running egg_info writing libKMCUDA.egg-info/PKG-INFO writing dependency_links to libKMCUDA.egg-info/dependency_links.txt writing requirements to libKMCUDA.egg-info/requires.txt writing top-level names to libKMCUDA.egg-info/top_level.txt file libKMCUDA.py (for module libKMCUDA) not found writing manifest file 'libKMCUDA.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py -- The C compiler identification is GNU 7.5.0 -- The CXX compiler identification is GNU 7.5.0 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Found OpenMP_C: -fopenmp (found version "4.5") -- Found OpenMP_CXX: -fopenmp (found version "4.5") -- Found OpenMP: TRUE (found version "4.5")
-- Looking for pthread.h -- Looking for pthread.h - found -- Looking for pthread_create -- Looking for pthread_create - not found -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE
-- Found PythonInterp: /usr/bin/python3 (found suitable version "3.6.9", minimum required is "3") -- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.6m.so (found suitable version "3.6.9", minimum required is "3") -- Configuring done -- Generating done -- Build files have been written to: /content/kmcuda/src [ 16%] Building NVCC (Device) object CMakeFiles/KMCUDA.dir/KMCUDA_generated_transpose.cu.o [ 33%] Building NVCC (Device) object CMakeFiles/KMCUDA.dir/KMCUDA_generated_kmeans.cu.o ptxas info : 0 bytes gmem ptxas info : Compiling entry function '_Z9transposeILb0EEvPKfjjPf' for 'sm_61' ptxas info : Function properties for _Z9transposeILb0EEvPKfjjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 25 registers, 4224 bytes smem, 344 bytes cmem[0] ptxas info : Compiling entry function '_Z9transposeILb1EEvPKfjjPf' for 'sm_61' ptxas info : Function properties for _Z9transposeILb1EEvPKfjjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 25 registers, 4224 bytes smem, 344 bytes cmem[0] ptxas info : Compiling entry function '_Z13copy_sample_tjjtPKfPf' for 'sm_61' ptxas info : Function properties for _Z13copy_sample_tjjtPKfPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 8 registers, 352 bytes cmem[0] [ 50%] Building NVCC (Device) object CMakeFiles/KMCUDA.dir/KMCUDA_generated_knn.cu.o ptxas info : 64529 bytes gmem, 92 bytes cmem[3] ptxas info : Compiling entry function '_Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4_PKjPd' for 'sm_61' ptxas info : Function properties for _Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric1E7__half2EvjjPKT0_S4_PKjPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjPd' for 'sm_61' ptxas info : Function properties for _Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4_PKjPd' for 'sm_61' ptxas info : Function properties for _Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4_PKjPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjPd' for 'sm_61' ptxas info : Function properties for _Z28kmeans_calc_average_distanceIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 31 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS4_S6_PKfPjPf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS4_S6_PKfPjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 384 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_S5_PKfPjPf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_S5_PKfPjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 39 registers, 384 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_S6_PKfPjPf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_S6_PKfPjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 384 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_S5_PKfPjPf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_yy_local_filterIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_S5_PKfPjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 39 registers, 384 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric1E7__half2EvjjPKT0_S4_PKjPKfS6PjPfS9' for 'sm_61' ptxas info : Function properties for _Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4_PKjPKfS6PjPfS9 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 392 bytes cmem[0], 32 bytes cmem[2] ptxas info : Compiling entry function '_Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjPKfS5PjPfS8' for 'sm_61' ptxas info : Function properties for _Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjPKfS5PjPfS8 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 392 bytes cmem[0], 32 bytes cmem[2] ptxas info : Compiling entry function '_Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4_PKjPKfS6PjPfS9' for 'sm_61' ptxas info : Function properties for _Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric0E7__half2EvjjPKT0_S4_PKjPKfS6PjPfS9 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 392 bytes cmem[0], 12 bytes cmem[2] ptxas info : Compiling entry function '_Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjPKfS5PjPfS8' for 'sm_61' ptxas info : Function properties for _Z23kmeans_yy_global_filterIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjPKfS5PjPfS8 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 392 bytes cmem[0], 12 bytes cmem[2] ptxas info : Compiling entry function '_Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric1E7half2EvjjPKT0PS2' for 'sm_61' ptxas info : Function properties for _Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric1E7half2EvjjPKT0PS2 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 23 registers, 344 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric1EfEvjjPKT0PS1' for 'sm_61' ptxas info : Function properties for _Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric1EfEvjjPKT0PS1 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 23 registers, 344 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric0E7__half2EvjjPKT0PS2' for 'sm_61' ptxas info : Function properties for _Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric0E7half2EvjjPKT0PS2 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 21 registers, 344 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric0EfEvjjPKT0PS1' for 'sm_61' ptxas info : Function properties for _Z21kmeans_yy_calc_driftsIL20KMCUDADistanceMetric0EfEvjjPKT0PS1 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 21 registers, 344 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z14kmeans_yy_initIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4_PKjS6_Pf' for 'sm_61' ptxas info : Function properties for _Z14kmeans_yy_initIL20KMCUDADistanceMetric1E7__half2EvjjPKT0_S4_PKjS6_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 368 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z14kmeans_yy_initIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjS5_Pf' for 'sm_61' ptxas info : Function properties for _Z14kmeans_yy_initIL20KMCUDADistanceMetric1EfEvjjPKT0_S3_PKjS5_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 368 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z14kmeans_yy_initIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4_PKjS6_Pf' for 'sm_61' ptxas info : Function properties for _Z14kmeans_yy_initIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4_PKjS6_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 368 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z14kmeans_yy_initIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjS5_Pf' for 'sm_61' ptxas info : Function properties for _Z14kmeans_yy_initIL20KMCUDADistanceMetric0EfEvjjPKT0_S3_PKjS5_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 368 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z13kmeans_adjustIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS6_PS2_Pj' for 'sm_61' ptxas info : Function properties for _Z13kmeans_adjustIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS6_PS2_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 20 bytes cmem[2] ptxas info : Compiling entry function '_Z13kmeans_adjustIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS5_PS1_Pj' for 'sm_61' ptxas info : Function properties for _Z13kmeans_adjustIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS5_PS1_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 20 bytes cmem[2] ptxas info : Compiling entry function '_Z13kmeans_adjustIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS6_PS2_Pj' for 'sm_61' ptxas info : Function properties for _Z13kmeans_adjustIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS6_PS2_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z13kmeans_adjustIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS5_PS1_Pj' for 'sm_61' ptxas info : Function properties for _Z13kmeans_adjustIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS5_PS1_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 12 bytes cmem[2] ptxas info : Compiling entry function '_Z19kmeans_assign_lloydIL20KMCUDADistanceMetric1E7__half2EvjjPKT0_S4PjS5' for 'sm_61' ptxas info : Function properties for _Z19kmeans_assign_lloydIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4PjS5 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 32 bytes cmem[2] ptxas info : Compiling entry function '_Z19kmeans_assign_lloydIL20KMCUDADistanceMetric1EfEvjjPKT0_S3PjS4' for 'sm_61' ptxas info : Function properties for _Z19kmeans_assign_lloydIL20KMCUDADistanceMetric1EfEvjjPKT0_S3PjS4 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z19kmeans_assign_lloydIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4PjS5' for 'sm_61' ptxas info : Function properties for _Z19kmeans_assign_lloydIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4PjS5 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 4 bytes cmem[2] ptxas info : Compiling entry function '_Z19kmeans_assign_lloydIL20KMCUDADistanceMetric0EfEvjjPKT0_S3PjS4' for 'sm_61' ptxas info : Function properties for _Z19kmeans_assign_lloydIL20KMCUDADistanceMetric0EfEvjjPKT0_S3PjS4 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0] ptxas info : Compiling entry function '_Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4PjS5' for 'sm_61' ptxas info : Function properties for _Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric1E7half2EvjjPKT0_S4PjS5 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 32 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric1EfEvjjPKT0_S3PjS4' for 'sm_61' ptxas info : Function properties for _Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric1EfEvjjPKT0_S3PjS4 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric0E7half2EvjjPKT0_S4PjS5' for 'sm_61' ptxas info : Function properties for _Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric0E7__half2EvjjPKT0_S4PjS5 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0], 4 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric0EfEvjjPKT0_S3PjS4' for 'sm_61' ptxas info : Function properties for _Z26kmeans_assign_lloyd_smallcIL20KMCUDADistanceMetric0EfEvjjPKT0_S3PjS4 8 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 40 registers, 360 bytes cmem[0] ptxas info : Compiling entry function '_Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS4_Pf' for 'sm_61' ptxas info : Function properties for _Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS4_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_Pf' for 'sm_61' ptxas info : Function properties for _Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_Pf' for 'sm_61' ptxas info : Function properties for _Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_Pf' for 'sm_61' ptxas info : Function properties for _Z33kmeans_afkmc2_min_dist_transposedIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric1E7__half2EvjjPKT0_PKjS4_Pf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric1E7half2EvjjPKT0_PKjS4_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_Pf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric1EfEvjjPKT0_PKjS3_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_Pf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric0E7half2EvjjPKT0_PKjS4_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_Pf' for 'sm_61' ptxas info : Function properties for _Z22kmeans_afkmc2_min_distIL20KMCUDADistanceMetric0EfEvjjPKT0_PKjS3_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric1E7half2EvjjjPKT0_PfPd' for 'sm_61' ptxas info : Function properties for _Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric1E7half2EvjjjPKT0_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 36 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric1EfEvjjjPKT0_PfPd' for 'sm_61' ptxas info : Function properties for _Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric1EfEvjjjPKT0_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 36 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric0E7half2EvjjjPKT0_PfPd' for 'sm_61' ptxas info : Function properties for _Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric0E7__half2EvjjjPKT0_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 360 bytes cmem[0], 16 bytes cmem[2] ptxas info : Compiling entry function '_Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric0EfEvjjjPKT0_PfPd' for 'sm_61' ptxas info : Function properties for _Z26kmeans_afkmc2_calc_q_distsIL20KMCUDADistanceMetric0EfEvjjjPKT0_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 30 registers, 360 bytes cmem[0], 16 bytes cmem[2] ptxas info : Compiling entry function '_Z16kmeans_plus_plusIL20KMCUDADistanceMetric1E7half2EvjjjPKT0_S4_PfPd' for 'sm_61' ptxas info : Function properties for _Z16kmeans_plus_plusIL20KMCUDADistanceMetric1E7half2EvjjjPKT0_S4_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 32 bytes cmem[2] ptxas info : Compiling entry function '_Z16kmeans_plus_plusIL20KMCUDADistanceMetric1EfEvjjjPKT0_S3_PfPd' for 'sm_61' ptxas info : Function properties for _Z16kmeans_plus_plusIL20KMCUDADistanceMetric1EfEvjjjPKT0_S3_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z16kmeans_plus_plusIL20KMCUDADistanceMetric0E7half2EvjjjPKT0_S4_PfPd' for 'sm_61' ptxas info : Function properties for _Z16kmeans_plus_plusIL20KMCUDADistanceMetric0E7half2EvjjjPKT0_S4_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 368 bytes cmem[0], 12 bytes cmem[2] ptxas info : Compiling entry function '_Z16kmeans_plus_plusIL20KMCUDADistanceMetric0EfEvjjjPKT0_S3_PfPd' for 'sm_61' ptxas info : Function properties for _Z16kmeans_plus_plusIL20KMCUDADistanceMetric0EfEvjjjPKT0_S3_PfPd 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 31 registers, 368 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z31kmeans_yy_find_group_max_driftsjjPKjPf' for 'sm_61' ptxas info : Function properties for _Z31kmeans_yy_find_group_max_driftsjjPKjPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 344 bytes cmem[0] ptxas info : Compiling entry function '_Z25kmeans_afkmc2_random_stepjmmPKfPjPf' for 'sm_61' ptxas info : Function properties for _Z25kmeans_afkmc2_random_stepjmmPKfPjPf 6440 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 43 registers, 32768 bytes smem, 368 bytes cmem[0], 60 bytes cmem[2] ptxas info : Compiling entry function '_Z20kmeans_afkmc2_calc_qjjfPf' for 'sm_61' ptxas info : Function properties for _Z20kmeans_afkmc2_calc_qjjfPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 14 registers, 344 bytes cmem[0], 20 bytes cmem[2] ptxas info : 8 bytes gmem, 12 bytes cmem[3] ptxas info : Compiling entry function '_Z16knn_assign_shmemIL20KMCUDADistanceMetric1E7__half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj' for 'sm_61' ptxas info : Function properties for _Z16knn_assign_shmemIL20KMCUDADistanceMetric1E7half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 43 registers, 400 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z16knn_assign_shmemIL20KMCUDADistanceMetric1EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj' for 'sm_61' ptxas info : Function properties for _Z16knn_assign_shmemIL20KMCUDADistanceMetric1EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 41 registers, 400 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z16knn_assign_shmemIL20KMCUDADistanceMetric0E7half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj' for 'sm_61' ptxas info : Function properties for _Z16knn_assign_shmemIL20KMCUDADistanceMetric0E7__half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 48 registers, 400 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z16knn_assign_shmemIL20KMCUDADistanceMetric0EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj' for 'sm_61' ptxas info : Function properties for _Z16knn_assign_shmemIL20KMCUDADistanceMetric0EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 41 registers, 400 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z15knn_assign_gmemIL20KMCUDADistanceMetric1E7half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj' for 'sm_61' ptxas info : Function properties for _Z15knn_assign_gmemIL20KMCUDADistanceMetric1E7half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 56 registers, 400 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z15knn_assign_gmemIL20KMCUDADistanceMetric1EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj' for 'sm_61' ptxas info : Function properties for _Z15knn_assign_gmemIL20KMCUDADistanceMetric1EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 51 registers, 400 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z15knn_assign_gmemIL20KMCUDADistanceMetric0E7__half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj' for 'sm_61' ptxas info : Function properties for _Z15knn_assign_gmemIL20KMCUDADistanceMetric0E7half2EvjjtPKfS3_PKT0_S6_PKjS8_S8_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 56 registers, 400 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z15knn_assign_gmemIL20KMCUDADistanceMetric0EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj' for 'sm_61' ptxas info : Function properties for _Z15knn_assign_gmemIL20KMCUDADistanceMetric0EfEvjjtPKfS2_PKT0_S5_PKjS7_S7_Pj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 41 registers, 400 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric1E7half2EvjPKT0_Pf' for 'sm_61' ptxas info : Function properties for _Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric1E7half2EvjPKT0_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 39 registers, 49152 bytes smem, 344 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric1EfEvjPKT0_Pf' for 'sm_61' ptxas info : Function properties for _Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric1EfEvjPKT0_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 38 registers, 49152 bytes smem, 344 bytes cmem[0], 28 bytes cmem[2] ptxas info : Compiling entry function '_Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric0E7half2EvjPKT0_Pf' for 'sm_61' ptxas info : Function properties for _Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric0E7half2EvjPKT0_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 35 registers, 49152 bytes smem, 344 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric0EfEvjPKT0_Pf' for 'sm_61' ptxas info : Function properties for _Z26knn_calc_cluster_distancesIL20KMCUDADistanceMetric0EfEvjPKT0_Pf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 33 registers, 49152 bytes smem, 344 bytes cmem[0], 8 bytes cmem[2] ptxas info : Compiling entry function '_Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric1E7half2EvjjPKjS3_PKT0_S6PfS7' for 'sm_61' ptxas info : Function properties for _Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric1E7__half2EvjjPKjS3_PKT0_S6PfS7 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 32768 bytes smem, 376 bytes cmem[0], 36 bytes cmem[2] ptxas info : Compiling entry function '_Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric1EfEvjjPKjS2_PKT0_S5PfS6' for 'sm_61' ptxas info : Function properties for _Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric1EfEvjjPKjS2_PKT0_S5PfS6 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 32768 bytes smem, 376 bytes cmem[0], 36 bytes cmem[2] ptxas info : Compiling entry function '_Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric0E7half2EvjjPKjS3_PKT0_S6PfS7' for 'sm_61' ptxas info : Function properties for _Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric0E7__half2EvjjPKjS3_PKT0_S6PfS7 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 32768 bytes smem, 376 bytes cmem[0], 16 bytes cmem[2] ptxas info : Compiling entry function '_Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric0EfEvjjPKjS2_PKT0_S5PfS6' for 'sm_61' ptxas info : Function properties for _Z25knn_calc_cluster_radiusesIL20KMCUDADistanceMetric0EfEvjjPKjS2_PKT0_S5PfS6 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 32 registers, 32768 bytes smem, 376 bytes cmem[0], 16 bytes cmem[2] ptxas info : Compiling entry function '_Z29knn_assign_gmem_deinterleave2jtPj' for 'sm_61' ptxas info : Function properties for _Z29knn_assign_gmem_deinterleave2jtPj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 23 registers, 336 bytes cmem[0] ptxas info : Compiling entry function '_Z29knn_assign_gmem_deinterleave1jtPj' for 'sm_61' ptxas info : Function properties for _Z29knn_assign_gmem_deinterleave1jtPj 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 23 registers, 336 bytes cmem[0] ptxas info : Compiling entry function '_Z28knn_mirror_cluster_distancesPf' for 'sm_61' ptxas info : Function properties for _Z28knn_mirror_cluster_distancesPf 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads ptxas info : Used 26 registers, 328 bytes cmem[0], 8 bytes cmem[2] Scanning dependencies of target KMCUDA [ 83%] Building CXX object CMakeFiles/KMCUDA.dir/python.cc.o [ 83%] Building CXX object CMakeFiles/KMCUDA.dir/kmcuda.cc.o [100%] Linking CXX shared library libKMCUDA.so [100%] Built target KMCUDA creating build creating build/lib file libKMCUDA.py (for module libKMCUDA) not found file libKMCUDA.py (for module libKMCUDA) not found running build_ext creating build/bdist.linux-x86_64 creating build/bdist.linux-x86_64/egg copying build/lib/libKMCUDA.so -> build/bdist.linux-x86_64/egg creating build/bdist.linux-x86_64/egg/EGG-INFO copying libKMCUDA.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO copying libKMCUDA.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying libKMCUDA.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying libKMCUDA.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying libKMCUDA.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt zip_safe flag not set; analyzing archive contents... creating dist creating 'dist/libKMCUDA-6.2.3-py3.6-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it removing 'build/bdist.linux-x86_64/egg' (and everything under it) Processing libKMCUDA-6.2.3-py3.6-linux-x86_64.egg Copying libKMCUDA-6.2.3-py3.6-linux-x86_64.egg to /usr/local/lib/python3.6/dist-packages Adding libKMCUDA 6.2.3 to easy-install.pth file

Installed /usr/local/lib/python3.6/dist-packages/libKMCUDA-6.2.3-py3.6-linux-x86_64.egg Processing dependencies for libKMCUDA==6.2.3 Searching for numpy==1.18.2 Best match: numpy 1.18.2 Adding numpy 1.18.2 to easy-install.pth file Installing f2py script to /usr/local/bin Installing f2py3 script to /usr/local/bin Installing f2py3.6 script to /usr/local/bin

Using /usr/local/lib/python3.6/dist-packages Finished processing dependencies for libKMCUDA==6.2.3

DevashishX commented 4 years ago

but when i do from libKMCUDA import kmeans_cuda it gives a module not found error- ModuleNotFoundError: No module named 'libKMCUDA'

although in pip list libKMCUDA 6.2.3 is available

it works when I do import kmcuda but none of the functions can be imported it gives import error

if i do help(kmcuda)

Help on package kmcuda:

NAME
    kmcuda

PACKAGE CONTENTS

FILE
    (built-in)
DevashishX commented 4 years ago

I have solved the issue just install with !export CUDA_TOOLKIT_ROOT_DIR='/usr/local/cuda'; export CUDA_ARCH=75; export DISABLE_R='y';pip install libKMCUDA

although I am not sure about the CUDA_ARCH version number