Open HGanFan opened 1 month ago
Hi @HGanFan, it looks like you are using a system with glibc 2.17 (Enterprise Linux 7 / CentOS 7). RAPIDS has dropped support for this in the 24.06 release because CentOS 7 reached end of life as of June 2024. You can use RAPIDS 24.04 or update your Linux distribution (Ubuntu 20.04+ or RHEL / Rocky 8+ are supported, as are many other recent distributions). Though pip wheels will not be installable, you may also be able to install RAPIDS conda packages (until conda-forge migrates to a minimum of glibc 2.28) or Docker containers on your current OS. Please try some of those options and let us know if you need more help.
Hi!!!@bdice
My system information is "Linux version 3.10.0-1160.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) )".
And I follow your suggestion and install cudf=23.8, but when I import cudf, I meet the following error:
import cudf Traceback (most recent call last): File "
", line 1, in File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/cudf/init.py", line 10, in validate_setup() File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/cudf/utils/gpu_utils.py", line 95, in validate_setup cuda_runtime_version = runtimeGetVersion() File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/rmm/_cuda/gpu.py", line 88, in runtimeGetVersion major, minor = numba.cuda.runtime.get_version() File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/numba/cuda/cudadrv/runtime.py", line 111, in get_version self.cudaRuntimeGetVersion(ctypes.byref(rtver)) File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/numba/cuda/cudadrv/runtime.py", line 65, in getattr self._initialize() File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/numba/cuda/cudadrv/runtime.py", line 51, in _initialize self.lib = open_cudalib('cudart') File "/data/anaconda3/envs/largemodel2/lib/python3.9/site-packages/numba/cuda/cudadrv/libs.py", line 65, in open_cudalib return ctypes.CDLL(path) File "/data/anaconda3/envs/largemodel2/lib/python3.9/ctypes/init.py", line 382, in init self._handle = _dlopen(self._name, mode) OSError: libcudart.so: cannot open shared object file: No such file or directory
My cuda is 11.8 and I install it under the guidance "https://developer.nvidia.com/cuda-11-8-0-download-archive?target_os=Linux&target_arch=x86_64&Distribution=CentOS&target_version=7&target_type=runfile_local".
Can you help me to fix this error? Look forward to your reply!
Hi!!!@bdice Can you help me to fix this error?
@HGanFan, sorry for the delay. Can you share the output of nvidia-smi
? Also, do you see the libcudart.so
library on your system? It may have installed to a location like /usr/local/cuda/...
. I apologize, I won't be able to debug your system very effectively, but perhaps the above steps will help. Also, the RAPIDS 23.08 release is fairly old. If you're stuck with CentOS 7, you may want to try 24.04 instead. It is the final release with CentOS 7 support.
Hi!!! When I try to use "pip install --extra-index-url https://pypi.nvidia.com cudf-cu11" to install cudf, I meet the following error:
Collecting cudf-cu11 Using cached cudf_cu11-24.6.1.tar.gz (2.6 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... error error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [104 lines of output] File "/tmp/pip-build-env-czfl19z8/overlay/lib/python3.10/site-packages/nvidia_stub/wheel.py", line 177, in download_wheel return download_manual(wheel_directory, distribution, version) File "/tmp/pip-build-env-czfl19z8/overlay/lib/python3.10/site-packages/nvidia_stub/wheel.py", line 137, in download_manual index_response = urlopen_with_retry(f"{NVIDIA_PIP_INDEX_URL}/{distribution}/") File "/tmp/pip-build-env-czfl19z8/overlay/lib/python3.10/site-packages/nvidia_stub/wheel.py", line 70, in urlopen_with_retry return urlopen(url, *kwargs) File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 216, in urlopen return opener.open(url, data, timeout) File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 519, in open response = self._open(req, data) File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 536, in _open result = self._call_chain(self.handle_open, protocol, protocol + File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 496, in _call_chain result = func(args) File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 1391, in https_open return self.do_open(http.client.HTTPSConnection, req, File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 1351, in do_open raise URLError(err) Traceback (most recent call last): File "/data/anaconda3/envs/largemodel/lib/python3.10/urllib/request.py", line 1348, in do_open h.request(req.get_method(), req.selector, req.data, headers, File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 1276, in request self._send_request(method, url, body, headers, encode_chunked) File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 1322, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 1271, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 1031, in _send_output self.send(msg) File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 969, in send self.connect() File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 1441, in connect super().connect() File "/data/anaconda3/envs/largemodel/lib/python3.10/http/client.py", line 940, in connect self.sock = self._create_connection( File "/data/anaconda3/envs/largemodel/lib/python3.10/socket.py", line 845, in create_connection raise err File "/data/anaconda3/envs/largemodel/lib/python3.10/socket.py", line 833, in create_connection sock.connect(sa) TimeoutError: [Errno 110] Connection timed out
note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed
× Encountered error while generating package metadata. ╰─> See above for output.
note: This is an issue with the package mentioned above, not pip. hint: See above for details.
And when I try to install cudf with whl file, for example, "pip install cudf_cu11-24.6.1-cp310-cp310-manylinux_2_28_x86_64.whl", I meet
ERROR: cudf_cu11-24.6.1-cp310-cp310-manylinux_2_28_x86_64.whl is not a supported wheel on this platform.
So can you help to address this trouble and install cudf successfully? Look forward to your reply!!!!