search

nv-legate / legate.core

The Foundation for All Legate Libraries
https://docs.nvidia.com/legate/24.06/
Apache License 2.0
186 stars 62 forks source link

Buliding by install.py fails with subprocess-exited-with-error #476

Open LUOXIAO92 opened 1 year ago

LUOXIAO92 commented 1 year ago

It seems the main error is subprocess-exited-with-error. I also found the same issue. https://github.com/nv-legate/legate.core/issues/107#issue-1054642948 But in my case, I'm using python 3.9, so it should not be the problem about version of python. I also tried python 3.10, and the same error occurs.

full log of output ``` Verbose build is off Using python lib and version: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/libpython3.9.so, 3.9.13 Performing a clean build to accommodate build isolation. Processing /home/DENSEQCD/luoxiao/downloads/legate.core Installing build dependencies ... error error: subprocess-exited-with-error × pip subprocess to install build dependencies did not run successfully. │ exit code: 1 ╰─> [7 lines of output] WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/wheel/ WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/wheel/ WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/wheel/ WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/wheel/ WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/wheel/ ERROR: Could not find a version that satisfies the requirement wheel (from versions: none) ERROR: No matching distribution found for wheel [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error × pip subprocess to install build dependencies did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 751, in driver() File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 747, in driver install(unknown=unknown, **vars(args)) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 474, in install execute_command(pip_install_cmd, verbose, cwd=legate_core_dir, env=cmd_env) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 74, in execute_command subprocess.check_call(args, **kwargs) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3', '-m', 'pip', 'install', '--root', '/', '--prefix', '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate', '--upgrade', '.']' returned non-zero exit status 1. ```
manopapad commented 1 year ago

@LUOXIAO92 can you try building with --verbose, so we get a little more output?

As far as I can tell, it looks like pip was not able to connect to its repository to download build dependencies. Do I have it right @bryevdv ?

bryevdv commented 1 year ago

It looks plausible but agree --verbose output is needed (as well as the exact invocation used)

LUOXIAO92 commented 1 year ago

@LUOXIAO92 can you try building with --verbose, so we get a little more output?

As far as I can tell, it looks like pip was not able to connect to its repository to download build dependencies. Do I have it right @bryevdv ?

It looks plausible but agree --verbose output is needed (as well as the exact invocation used)

Do you mean it is necessary to connect to internet while building legate.core? I'm building this on our schools' HPC, and we have to use the debug node to load cuda module, because the login node do not have any gpu, and the debug node can not connect to internet. By the way, "If using UCX, a build configured with --enable-mt is required." is written in the BUILD.md https://github.com/nv-legate/legate.core/blob/branch-22.12/BUILD.md . I want to use UCX and add this option at install.py, but fails with "no such option: --enable-mt", what should I do?

--verbose: ``` $ ./install.py --max-dim 16 --network mpi --cuda --openmp --verbose Verbose build is on networks: ['mpi'] cuda: True arch: NATIVE openmp: True march: native hdf: False llvm: False spy: False conduit: None nccl_dir: None cmake_exe: cmake cmake_generator: None gasnet_dir: None cuda_dir: None maxdim: 16 maxfields: 256 debug: False debug_release: False check_bounds: False clean_first: True extra_flags: [] editable: False build_isolation: True thread_count: None verbose: True thrust_dir: None legion_dir: None legion_src_dir: None legion_url: https://gitlab.com/StanfordLegion/legion.git legion_branch: control_replication unknown: [] Using python lib and version: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/libpython3.9.so, 3.9.13 legate_core_dir: /home/DENSEQCD/luoxiao/downloads/legate.core cuda_dir: None nccl_dir: None legion_dir: None legion_src_dir: None gasnet_dir: None thrust_dir: None install_dir: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate Executing: " /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -m pip install --root / --prefix /home/DENSEQCD/luoxiao/.miniconda3/envs/legate --upgrade . -vv " with {'cwd': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'env': {'AS': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-as', 'LDFLAGS': '-Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined -Wl,-rpath,/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib -Wl,-rpath-link,/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib -L/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib', 'AR': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar', 'CUDA_PATH': '/system/apps/rhel79_2022/cuda/11.6.2', 'MANPATH': '/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/share/man:/opt/nec/nqsv/man/ja/man1:', 'GCC_NM': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-nm', 'HOSTNAME': 'gnode47', 'OMPI_MCA_btl_openib_allow_ib': '1', 'QUEUENAME': 'debug', '_NECMPI_JOBTYPE': 'DISTRIB', 'HOST': 'x86_64-conda-linux-gnu', 'TERM': 'xterm-256color', 'SHELL': '/bin/bash', 'NM': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-nm', 'HISTSIZE': '1000', 'CPPFLAGS': '-DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'PBS_JOBNAME': 'QLOGIN', 'PBS_JSVNO': '0147', 'LIBRARY_PATH': '/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/lib:/system/apps/rhel79_2022/ucx/1.7.0-cuda11.6.2/lib:/opt/gdrcopy:/system/apps/rhel79_2022/cuda/11.6.2/lib64', 'CONDA_SHLVL': '1', 'CONDA_PROMPT_MODIFIER': '(legate) ', 'VE_NODE_NUMBER': '', 'SIZE': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-size', 'PBS_ENVIRONMENT': 'PBS_INTERACTIVE', 'OLDPWD': '/home/DENSEQCD/luoxiao', 'STGDIR': '/var/opt/nec/nqsv/jsv/jobfile/0.863368.10/stgfile', 'CXX_FOR_BUILD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++', 'PBS_O_WORKDIR': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'CUDA_HOME': '/system/apps/rhel79_2022/cuda/11.6.2', 'NQSV_CR_UNIT_Share': '', 'USER': 'luoxiao', 'LD_LIBRARY_PATH': '/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/lib:/system/apps/rhel79_2022/ucx/1.7.0-cuda11.6.2/lib:/opt/gdrcopy:/system/apps/rhel79_2022/cuda/11.6.2/lib64', 'LS_COLORS': 'rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'PBS_O_HOME': '/home/DENSEQCD/luoxiao', 'CONDA_TOOLCHAIN_BUILD': 'x86_64-conda-linux-gnu', 'CONDA_EXE': '/home/DENSEQCD/luoxiao/.miniconda3/bin/conda', 'VE_LIMIT_OPT': '-t unlimited -m unlimited', 'CPATH': '/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/include:/system/apps/rhel79_2022/ucx/1.7.0-cuda11.6.2/include:/opt/gdrcopy:/system/apps/rhel79_2022/cuda/11.6.2/include', 'CXXFLAGS': '-fvisibility-inlines-hidden -std=c++17 -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'LD_GOLD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld.gold', 'CONDA_BUILD_SYSROOT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/x86_64-conda-linux-gnu/sysroot', 'CONDA_TOOLCHAIN_HOST': 'x86_64-conda-linux-gnu', 'STRINGS': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strings', 'CPP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cpp', '_CE_CONDA': '', 'CXXFILT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++filt', 'MAIL': '/var/spool/mail/luoxiao', 'PBS_O_LOGNAME': 'luoxiao', 'PATH': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin:/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/bin:/system/apps/rhel79_2022/ucx/1.7.0-cuda11.6.2/bin:/system/apps/rhel79_2022/cuda/11.6.2/bin:/home/DENSEQCD/luoxiao/.miniconda3/condabin:/bin:/usr/bin:/usr/ucb:/usr/local/sbin:/usr/sbin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin:/home/DENSEQCD/luoxiao/.local/bin:/home/DENSEQCD/luoxiao/bin', 'PBS_O_LANG': 'ja_JP.UTF-8', 'OMPI_MCA_opal_warn_on_missing_libcuda': '0', 'DEBUG_CXXFLAGS': '-fvisibility-inlines-hidden -std=c++17 -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'BUILD': 'x86_64-conda-linux-gnu', 'LD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld', 'CONDA_PREFIX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate', 'PWD': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'STRIP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip', '_LMFILES_': '/system/apps/env/compiler/cuda/11.6.2:/system/apps/env/lib/ucx/gdr/1.7.0-cuda11.6.2:/system/apps/env/openmpi/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0', 'CMAKE_ARGS': '-DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=16 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication', 'ELFEDIT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-elfedit', 'OMPI_MCA_opal_common_ucx_opal_mem_hooks': '1', 'GCC_RANLIB': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib', 'LANG': 'ja_JP.UTF-8', 'MODULEPATH': '/system/apps/env/compiler:/system/apps/env/openmpi:/system/apps/env/mvapich:/system/apps/env/intmpi:/system/apps/env/lib:/system/apps/env/hpci:/system/apps/env/misc', 'LOADEDMODULES': 'cuda/11.6.2:ucx/gdr/1.7.0-cuda11.6.2:openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0', 'OMPI_MCA_btl_openib_warn_default_gid_prefix': '0', 'OMPI_MCA_orte_base_help_aggregate': '0', 'PBS_O_SHELL': '/bin/bash', '_NEC_NQSV_JOB': '1', 'PBS_JOBID': '0:863368.nqsv', 'CXX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++', 'CC_FOR_BUILD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc', '_CE_M': '', 'HISTCONTROL': 'ignoredups', 'ENVIRONMENT': 'INTERACTIVE', 'OBJCOPY': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-objcopy', 'NQSII_CR_Share': '1', 'SHLVL': '1', 'HOME': '/home/DENSEQCD/luoxiao', 'DEBUG_CPPFLAGS': '-D_DEBUG -D_FORTIFY_SOURCE=2 -Og -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'CFLAGS': '-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'OMPI_MCA_btl_openib_warn_no_device_params_found': '0', '_VENODELIST': '', 'PBS_O_HOST': 'cygnus02', '_CONDA_PYTHON_SYSCONFIGDATA_NAME': '_sysconfigdata_x86_64_conda_cos6_linux_gnu', 'GCC': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc', 'UCX_MEMTYPE_CACHE': 'n', 'ADDR2LINE': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-addr2line', 'CONDA_PYTHON_EXE': '/home/DENSEQCD/luoxiao/.miniconda3/bin/python', 'LOGNAME': 'luoxiao', 'build_alias': 'x86_64-conda-linux-gnu', 'MODULESHOME': '/usr/share/Modules', 'CONDA_DEFAULT_ENV': 'legate', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'PBS_O_MAIL': '/var/spool/mail/luoxiao', 'OMP_NUM_THREADS': '24', 'DEBUG_CFLAGS': '-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'RANLIB': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib', 'NQSV_CR_Share': '1', 'CMAKE_PREFIX_PATH': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate:/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/x86_64-conda-linux-gnu/sysroot/usr', 'CC': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc', 'host_alias': 'x86_64-conda-linux-gnu', 'READELF': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-readelf', 'GCC_AR': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar', 'OBJDUMP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-objdump', 'NQSII_CR_UNIT_Share': '', 'GPROF': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gprof', 'OMPI_MCA_btl': '^openib', 'PBS_NODEFILE': '/var/opt/nec/nqsv/jsv/jobfile/0.863368.10/nodelist', 'GXX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-g++', 'PBS_O_PATH': '/home/DENSEQCD/luoxiao/.vscode-server/bin/8fa188b2b301d36553cbc9ce1b0a146ccb93351f/bin/remote-cli:/home/DENSEQCD/luoxiao/.miniconda3/condabin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin:/home/DENSEQCD/luoxiao/.local/bin:/home/DENSEQCD/luoxiao/bin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin', 'BASH_FUNC_module()': '() { eval `/usr/bin/modulecmd bash $*`\n}', '_': './install.py', 'SKBUILD_BUILD_OPTIONS': '-j24'}} Using pip 22.3.1 from /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip (python 3.9) Non-user install due to --prefix or --target option Created temporary directory: /tmp/pip-build-tracker-f_n8yri8 Initialized build tracking at /tmp/pip-build-tracker-f_n8yri8 Created build tracker: /tmp/pip-build-tracker-f_n8yri8 Entered build tracker: /tmp/pip-build-tracker-f_n8yri8 Created temporary directory: /tmp/pip-install-jo0nkhzz Created temporary directory: /tmp/pip-ephem-wheel-cache-16ya810s Processing /home/DENSEQCD/luoxiao/downloads/legate.core Added file:///home/DENSEQCD/luoxiao/downloads/legate.core to build tracker '/tmp/pip-build-tracker-f_n8yri8' Created temporary directory: /tmp/pip-build-env-d8v0ypqs Running command pip subprocess to install build dependencies Using pip 22.3.1 from /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip (python 3.9) WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] 名前またはサービスが不明です')': /simple/wheel/ WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] 名前またはサービスが不明です')': /simple/wheel/ WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] 名前またはサービスが不明です')': /simple/wheel/ WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] 名前またはサービスが不明です')': /simple/wheel/ WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] 名前またはサービスが不明です')': /simple/wheel/ ERROR: Could not find a version that satisfies the requirement wheel (from versions: none) ERROR: No matching distribution found for wheel error: subprocess-exited-with-error × pip subprocess to install build dependencies did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/__pip-runner__.py install --ignore-installed --no-user --prefix /tmp/pip-build-env-d8v0ypqs/overlay --no-warn-script-location -v --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- wheel ninja setuptools 'scikit-build>=0.13.1' 'cmake>=3.22.1,!=3.23.0' cwd: [inherit] Installing build dependencies ... error error: subprocess-exited-with-error × pip subprocess to install build dependencies did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. Exception information: Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper return func(self, options, args) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/commands/install.py", line 400, in run requirement_set = resolver.resolve( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 73, in resolve collected = self.factory.collect_root_requirements(root_reqs) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 491, in collect_root_requirements req = self._make_requirement_from_install_req( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 453, in _make_requirement_from_install_req cand = self._make_candidate_from_link( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link self._link_candidate_cache[link] = LinkCandidate( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__ super().__init__( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__ self.dist = self._prepare() File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare dist = self._prepare_distribution() File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/operations/prepare.py", line 491, in prepare_linked_requirement return self._prepare_linked_requirement(req, parallel_builds) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/operations/prepare.py", line 577, in _prepare_linked_requirement dist = _get_prepared_distribution( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/operations/prepare.py", line 69, in _get_prepared_distribution abstract_dist.prepare_distribution_metadata( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/distributions/sdist.py", line 38, in prepare_distribution_metadata self._prepare_build_backend(finder) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/distributions/sdist.py", line 70, in _prepare_build_backend self.req.build_env.install_requirements( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/build_env.py", line 216, in install_requirements self._install_requirements( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/build_env.py", line 274, in _install_requirements call_subprocess( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/utils/subprocess.py", line 224, in call_subprocess raise error pip._internal.exceptions.InstallationSubprocessError: pip subprocess to install build dependencies exited with 1 Remote version of pip: 22.3.1 Local version of pip: 22.3.1 Was pip installed by pip? False Removed file:///home/DENSEQCD/luoxiao/downloads/legate.core from build tracker '/tmp/pip-build-tracker-f_n8yri8' Removed build tracker: '/tmp/pip-build-tracker-f_n8yri8' Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 751, in driver() File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 747, in driver install(unknown=unknown, **vars(args)) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 474, in install execute_command(pip_install_cmd, verbose, cwd=legate_core_dir, env=cmd_env) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 74, in execute_command subprocess.check_call(args, **kwargs) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3', '-m', 'pip', 'install', '--root', '/', '--prefix', '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate', '--upgrade', '.', '-vv']' returned non-zero exit status 1. ```
bryevdv commented 1 year ago

@LUOXIAO92 By default the build uses pip/setuptools build-isolation, which is the modern, reproducible way to build Python packages. That means that setuptools will try to install the necessary build dependencies into an isolated environment using pip, i.e. from the internet. You can try passing --no-build-isolation to install.py but you will then still have to have all the necessary build dependencies installed on the machine one way or another:

requires = [
    "wheel",
    "ninja",
    "setuptools",
    "scikit-build>=0.13.1",
    "cmake>=3.22.1,!=3.23.0",
]
LUOXIAO92 commented 1 year ago

@LUOXIAO92 By default the build uses pip/setuptools build-isolation, which is the modern, reproducible way to build Python packages. That means that setuptools will try to install the necessary build dependencies into an isolated environment using pip, i.e. from the internet. You can try passing --no-build-isolation to install.py but you will then still have to have all the necessary build dependencies installed on the machine one way or another:

requires = [
    "wheel",
    "ninja",
    "setuptools",
    "scikit-build>=0.13.1",
    "cmake>=3.22.1,!=3.23.0",
]

Thanks, I installed the all dependencies 

$ conda list | grep -i -e wheel -e ninja -e setuptools -e scikit-build -e cmake
cmake                     3.24.3               h816a3e0_0    conda-forge
ninja                     1.11.0               h924138e_0    conda-forge
scikit-build              0.16.2             pyhb871ab6_0    conda-forge
setuptools                65.5.1             pyhd8ed1ab_0    conda-forge
wheel                     0.38.4             pyhd8ed1ab_0    conda-forge

and ran

./install.py --max-dim 9 --network mpi --cuda --openmp --no-build-isolation --verbose

but still failed with errors.

--verbose ``` $ ./install.py --max-dim 9 --network mpi --cuda --openmp --no-build-isolation --verbose Verbose build is on networks: ['mpi'] cuda: True arch: NATIVE openmp: True march: native hdf: False llvm: False spy: False conduit: None nccl_dir: None cmake_exe: cmake cmake_generator: Ninja gasnet_dir: None cuda_dir: None maxdim: 9 maxfields: 256 debug: False debug_release: False check_bounds: False clean_first: True extra_flags: [] editable: False build_isolation: False thread_count: None verbose: True thrust_dir: None legion_dir: None legion_src_dir: None legion_url: https://gitlab.com/StanfordLegion/legion.git legion_branch: control_replication unknown: [] Using python lib and version: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/libpython3.9.so, 3.9.13 legate_core_dir: /home/DENSEQCD/luoxiao/downloads/legate.core cuda_dir: None nccl_dir: None legion_dir: None legion_src_dir: None gasnet_dir: None thrust_dir: None install_dir: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate Executing: " /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -m pip install --root / --prefix /home/DENSEQCD/luoxiao/.miniconda3/envs/legate --no-deps --no-build-isolation --upgrade . -vv " with {'cwd': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'env': {'AS': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-as', 'LDFLAGS': '-Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined -Wl,-rpath,/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib -Wl,-rpath-link,/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib -L/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib', 'AR': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar', 'MANPATH': '/opt/nec/nqsv/man/ja/man1:', 'GCC_NM': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-nm', 'HOSTNAME': 'gnode47', 'QUEUENAME': 'debug', '_NECMPI_JOBTYPE': 'DISTRIB', 'HOST': 'x86_64-conda-linux-gnu', 'TERM': 'xterm-256color', 'SHELL': '/bin/bash', 'NM': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-nm', 'HISTSIZE': '1000', 'CPPFLAGS': '-DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'PBS_JOBNAME': 'QLOGIN', 'PBS_JSVNO': '0147', 'CONDA_SHLVL': '1', 'CONDA_PROMPT_MODIFIER': '(legate) ', 'VE_NODE_NUMBER': '', 'SIZE': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-size', 'PBS_ENVIRONMENT': 'PBS_INTERACTIVE', 'OLDPWD': '/home/DENSEQCD/luoxiao', 'STGDIR': '/var/opt/nec/nqsv/jsv/jobfile/0.863396.10/stgfile', 'CXX_FOR_BUILD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++', 'PBS_O_WORKDIR': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'NQSV_CR_UNIT_Share': '', 'USER': 'luoxiao', 'LS_COLORS': 'rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'PBS_O_HOME': '/home/DENSEQCD/luoxiao', 'CONDA_TOOLCHAIN_BUILD': 'x86_64-conda-linux-gnu', 'CONDA_EXE': '/home/DENSEQCD/luoxiao/.miniconda3/bin/conda', 'VE_LIMIT_OPT': '-t unlimited -m unlimited', 'CXXFLAGS': '-fvisibility-inlines-hidden -std=c++17 -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'LD_GOLD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld.gold', 'CONDA_BUILD_SYSROOT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/x86_64-conda-linux-gnu/sysroot', 'CONDA_TOOLCHAIN_HOST': 'x86_64-conda-linux-gnu', 'STRINGS': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strings', 'CPP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cpp', '_CE_CONDA': '', 'CXXFILT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++filt', 'MAIL': '/var/spool/mail/luoxiao', 'PBS_O_LOGNAME': 'luoxiao', 'PATH': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin:/home/DENSEQCD/luoxiao/.miniconda3/condabin:/bin:/usr/bin:/usr/ucb:/usr/local/sbin:/usr/sbin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin:/home/DENSEQCD/luoxiao/.local/bin:/home/DENSEQCD/luoxiao/bin', 'PBS_O_LANG': 'ja_JP.UTF-8', 'DEBUG_CXXFLAGS': '-fvisibility-inlines-hidden -std=c++17 -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'BUILD': 'x86_64-conda-linux-gnu', 'LD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld', 'CONDA_PREFIX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate', 'PWD': '/home/DENSEQCD/luoxiao/downloads/legate.core', 'STRIP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip', 'CMAKE_ARGS': '-DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip -GNinja --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=9 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication', 'ELFEDIT': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-elfedit', 'GCC_RANLIB': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib', 'LANG': 'ja_JP.UTF-8', 'MODULEPATH': '/system/apps/env/compiler:/system/apps/env/openmpi:/system/apps/env/mvapich:/system/apps/env/intmpi:/system/apps/env/lib:/system/apps/env/hpci:/system/apps/env/misc', 'LOADEDMODULES': '', 'PBS_O_SHELL': '/bin/bash', '_NEC_NQSV_JOB': '1', 'PBS_JOBID': '0:863396.nqsv', 'CXX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++', 'CC_FOR_BUILD': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc', '_CE_M': '', 'HISTCONTROL': 'ignoredups', 'ENVIRONMENT': 'INTERACTIVE', 'OBJCOPY': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-objcopy', 'NQSII_CR_Share': '1', 'SHLVL': '1', 'HOME': '/home/DENSEQCD/luoxiao', 'DEBUG_CPPFLAGS': '-D_DEBUG -D_FORTIFY_SOURCE=2 -Og -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'CFLAGS': '-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', '_VENODELIST': '', 'PBS_O_HOST': 'cygnus02', '_CONDA_PYTHON_SYSCONFIGDATA_NAME': '_sysconfigdata_x86_64_conda_cos6_linux_gnu', 'GCC': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc', 'ADDR2LINE': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-addr2line', 'CONDA_PYTHON_EXE': '/home/DENSEQCD/luoxiao/.miniconda3/bin/python', 'LOGNAME': 'luoxiao', 'build_alias': 'x86_64-conda-linux-gnu', 'MODULESHOME': '/usr/share/Modules', 'CONDA_DEFAULT_ENV': 'legate', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'PBS_O_MAIL': '/var/spool/mail/luoxiao', 'OMP_NUM_THREADS': '24', 'DEBUG_CFLAGS': '-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-all -fno-plt -Og -g -Wall -Wextra -fvar-tracking-assignments -ffunction-sections -pipe -isystem /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include', 'RANLIB': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib', 'NQSV_CR_Share': '1', 'CMAKE_PREFIX_PATH': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate:/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/x86_64-conda-linux-gnu/sysroot/usr', 'CC': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc', 'host_alias': 'x86_64-conda-linux-gnu', 'READELF': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-readelf', 'GCC_AR': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar', 'OBJDUMP': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-objdump', 'NQSII_CR_UNIT_Share': '', 'GPROF': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gprof', 'PBS_NODEFILE': '/var/opt/nec/nqsv/jsv/jobfile/0.863396.10/nodelist', 'GXX': '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-g++', 'PBS_O_PATH': '/system/apps/rhel79_2022/openmpi/gdr/4.1.2/gcc8.3.1-cuda11.6.2-ucx1.7.0/bin:/system/apps/rhel79_2022/ucx/1.7.0-cuda11.6.2/bin:/system/apps/rhel79_2022/cuda/11.6.2/bin:/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin:/home/DENSEQCD/luoxiao/.vscode-server/bin/8fa188b2b301d36553cbc9ce1b0a146ccb93351f/bin/remote-cli:/home/DENSEQCD/luoxiao/.miniconda3/condabin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin:/home/DENSEQCD/luoxiao/.local/bin:/home/DENSEQCD/luoxiao/bin:/system/tool/nqsv/bin:/opt/nec/nqsv/bin', 'BASH_FUNC_module()': '() { eval `/usr/bin/modulecmd bash $*`\n}', '_': './install.py', 'SKBUILD_BUILD_OPTIONS': '-j24'}} Using pip 22.3.1 from /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip (python 3.9) Non-user install due to --prefix or --target option Created temporary directory: /tmp/pip-build-tracker-t6_onl_j Initialized build tracking at /tmp/pip-build-tracker-t6_onl_j Created build tracker: /tmp/pip-build-tracker-t6_onl_j Entered build tracker: /tmp/pip-build-tracker-t6_onl_j Created temporary directory: /tmp/pip-install-0fyv8_tj Created temporary directory: /tmp/pip-ephem-wheel-cache-bj5zka0_ Processing /home/DENSEQCD/luoxiao/downloads/legate.core Added file:///home/DENSEQCD/luoxiao/downloads/legate.core to build tracker '/tmp/pip-build-tracker-t6_onl_j' Created temporary directory: /tmp/pip-modern-metadata-jh7l53is Running command Preparing metadata (pyproject.toml) /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/setuptools/dist.py:530: UserWarning: Normalizing '22.12.00.dev+51.geabdbef' to '22.12.0.dev0+51.geabdbef' warnings.warn(tmpl.format(**locals())) running dist_info creating /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info writing /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/PKG-INFO writing dependency_links to /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/dependency_links.txt writing entry points to /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/entry_points.txt writing requirements to /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/requires.txt writing top-level names to /tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/top_level.txt writing manifest file '/tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/SOURCES.txt' reading manifest file '/tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' adding license file 'LICENSE' writing manifest file '/tmp/pip-modern-metadata-jh7l53is/legate.core.egg-info/SOURCES.txt' creating '/tmp/pip-modern-metadata-jh7l53is/legate.core-22.12.0.dev0+51.geabdbef.dist-info' Preparing metadata (pyproject.toml) ... done Source in /home/DENSEQCD/luoxiao/downloads/legate.core has version 22.12.0.dev0+51.geabdbef, which satisfies requirement legate.core==22.12.0.dev0+51.geabdbef from file:///home/DENSEQCD/luoxiao/downloads/legate.core Removed legate.core==22.12.0.dev0+51.geabdbef from file:///home/DENSEQCD/luoxiao/downloads/legate.core from build tracker '/tmp/pip-build-tracker-t6_onl_j' Created temporary directory: /tmp/pip-unpack-2_o83uug Building wheels for collected packages: legate.core Created temporary directory: /tmp/pip-wheel-h0go26ls Destination directory: /tmp/pip-wheel-h0go26ls Running command Building wheel for legate.core (pyproject.toml) /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/setuptools/dist.py:530: UserWarning: Normalizing '22.12.00.dev+51.geabdbef' to '22.12.0.dev0+51.geabdbef' warnings.warn(tmpl.format(**locals())) -------------------------------------------------------------------------------- -- Trying "Ninja" generator -------------------------------- --------------------------- ---------------------- ----------------- ------------ ------- -- Not searching for unused variables given on the command line. -- The C compiler identification is GNU 10.4.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- The CXX compiler identification is GNU 10.4.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Configuring done -- Generating done -- Build files have been written to: /home/DENSEQCD/luoxiao/downloads/legate.core/_cmake_test_compile/build -- ------- ------------ ----------------- ---------------------- --------------------------- -------------------------------- -- Trying "Ninja" generator - success -------------------------------------------------------------------------------- Configuring Project Working directory: /home/DENSEQCD/luoxiao/downloads/legate.core/_skbuild/linux-x86_64-3.9/cmake-build Command: cmake /home/DENSEQCD/luoxiao/downloads/legate.core -G Ninja -DCMAKE_INSTALL_PREFIX:PATH=/home/DENSEQCD/luoxiao/downloads/legate.core/_skbuild/linux-x86_64-3.9/cmake-install -DPYTHON_VERSION_STRING:STRING=3.9.13 -DSKBUILD:INTERNAL=TRUE -DCMAKE_MODULE_PATH:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/skbuild/resources/cmake -DPYTHON_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPYTHON_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPYTHON_LIBRARY:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/libpython3.9.so -DPython_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPython_ROOT_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate -DPython_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPython_FIND_REGISTRY:STRING=NEVER -DPython_NumPy_INCLUDE_DIRS:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/numpy/core/include -DPython3_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPython3_ROOT_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate -DPython3_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPython3_FIND_REGISTRY:STRING=NEVER -DPython3_NumPy_INCLUDE_DIRS:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/numpy/core/include -DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=9 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication -DCMAKE_BUILD_TYPE:STRING=Release -DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip -GNinja --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=9 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication CMake Error at CMakeLists.txt:62 (include): include could not find requested file: rapids-cmake CMake Error at CMakeLists.txt:63 (include): include could not find requested file: rapids-cpm CMake Error at CMakeLists.txt:64 (include): include could not find requested file: rapids-cuda CMake Error at CMakeLists.txt:65 (include): include could not find requested file: rapids-export CMake Error at CMakeLists.txt:66 (include): include could not find requested file: rapids-find -- The C compiler identification is GNU 10.4.0 -- The CXX compiler identification is GNU 10.4.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done CMake Error at CMakeLists.txt:62 (include): include could not find requested file: rapids-cmake CMake Error at CMakeLists.txt:63 (include): include could not find requested file: rapids-cpm CMake Error at CMakeLists.txt:64 (include): include could not find requested file: rapids-cuda CMake Error at CMakeLists.txt:65 (include): include could not find requested file: rapids-export CMake Error at CMakeLists.txt:66 (include): include could not find requested file: rapids-find -- legate.core: Legion_SPY=OFF -- legate.core: Legion_USE_LLVM=OFF -- legate.core: Legion_USE_CUDA=ON -- legate.core: Legion_USE_HDF5=OFF -- legate.core: Legion_NETWORKS=mpi -- legate.core: Legion_USE_OpenMP=ON -- legate.core: Legion_BOUNDS_CHECKS=OFF -- legate.core: Legion_MAX_DIM=9 -- legate.core: Legion_MAX_FIELDS=256 -- legate.core: not setting NCCL_DIR -- legate.core: not setting Thrust_DIR -- legate.core: not setting CUDA_TOOLKIT_ROOT_DIR -- legate.core: CMAKE_CUDA_ARCHITECTURES=NATIVE -- legate.core: Legion_HIJACK_CUDART=OFF (from default value) CMake Error at legate_core_cpp.cmake:26 (rapids_cmake_write_version_file): Unknown CMake command "rapids_cmake_write_version_file". Call Stack (most recent call first): CMakeLists.txt:84 (include) -- Configuring incomplete, errors occurred! See also "/home/DENSEQCD/luoxiao/downloads/legate.core/_skbuild/linux-x86_64-3.9/cmake-build/CMakeFiles/CMakeOutput.log". Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/skbuild/setuptools_wrap.py", line 632, in setup env = cmkr.configure( File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/skbuild/cmaker.py", line 334, in configure raise SKBuildError( An error occurred while configuring with CMake. Command: cmake /home/DENSEQCD/luoxiao/downloads/legate.core -G Ninja -DCMAKE_INSTALL_PREFIX:PATH=/home/DENSEQCD/luoxiao/downloads/legate.core/_skbuild/linux-x86_64-3.9/cmake-install -DPYTHON_VERSION_STRING:STRING=3.9.13 -DSKBUILD:INTERNAL=TRUE -DCMAKE_MODULE_PATH:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/skbuild/resources/cmake -DPYTHON_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPYTHON_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPYTHON_LIBRARY:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/libpython3.9.so -DPython_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPython_ROOT_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate -DPython_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPython_FIND_REGISTRY:STRING=NEVER -DPython_NumPy_INCLUDE_DIRS:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/numpy/core/include -DPython3_EXECUTABLE:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 -DPython3_ROOT_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate -DPython3_INCLUDE_DIR:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/include/python3.9 -DPython3_FIND_REGISTRY:STRING=NEVER -DPython3_NumPy_INCLUDE_DIRS:PATH=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/numpy/core/include -DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=9 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication -DCMAKE_BUILD_TYPE:STRING=Release -DCMAKE_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ar -DCMAKE_CXX_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_C_COMPILER_AR=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ar -DCMAKE_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ranlib -DCMAKE_CXX_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_C_COMPILER_RANLIB=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-gcc-ranlib -DCMAKE_LINKER=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-ld -DCMAKE_STRIP=/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/x86_64-conda-linux-gnu-strip -GNinja --log-level=VERBOSE -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_MARCH=native -DCMAKE_CUDA_ARCHITECTURES=NATIVE -DLegion_MAX_DIM=9 -DLegion_MAX_FIELDS=256 -DLegion_SPY=OFF -DLegion_BOUNDS_CHECKS=OFF -DLegion_USE_CUDA=ON -DLegion_USE_OpenMP=ON -DLegion_USE_LLVM=OFF -DLegion_NETWORKS=mpi -DLegion_USE_HDF5=OFF -DLegion_USE_Python=ON -DLegion_Python_Version=3.9.13 -DLegion_REDOP_COMPLEX=ON -DLegion_REDOP_HALF=ON -DLegion_BUILD_BINDINGS=ON -DLegion_BUILD_JUPYTER=ON -DCPM_DOWNLOAD_Legion=ON -Dlegate_core_LEGION_REPOSITORY=https://gitlab.com/StanfordLegion/legion.git -Dlegate_core_LEGION_BRANCH=control_replication Source directory: /home/DENSEQCD/luoxiao/downloads/legate.core Working directory: /home/DENSEQCD/luoxiao/downloads/legate.core/_skbuild/linux-x86_64-3.9/cmake-build Please see CMake's output for more information. error: subprocess-exited-with-error × Building wheel for legate.core (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3 /home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py build_wheel /tmp/tmp67g8_lfo cwd: /home/DENSEQCD/luoxiao/downloads/legate.core Building wheel for legate.core (pyproject.toml) ... error ERROR: Failed building wheel for legate.core Failed to build legate.core ERROR: Could not build wheels for legate.core, which is required to install pyproject.toml-based projects Exception information: Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper return func(self, options, args) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/site-packages/pip/_internal/commands/install.py", line 464, in run raise InstallationError( pip._internal.exceptions.InstallationError: Could not build wheels for legate.core, which is required to install pyproject.toml-based projects Remote version of pip: 22.3.1 Local version of pip: 22.3.1 Was pip installed by pip? False Removed build tracker: '/tmp/pip-build-tracker-t6_onl_j' Traceback (most recent call last): File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 751, in driver() File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 747, in driver install(unknown=unknown, **vars(args)) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 474, in install execute_command(pip_install_cmd, verbose, cwd=legate_core_dir, env=cmd_env) File "/home/DENSEQCD/luoxiao/downloads/legate.core/./install.py", line 74, in execute_command subprocess.check_call(args, **kwargs) File "/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['/home/DENSEQCD/luoxiao/.miniconda3/envs/legate/bin/python3', '-m', 'pip', 'install', '--root', '/', '--prefix', '/home/DENSEQCD/luoxiao/.miniconda3/envs/legate', '--no-deps', '--no-build-isolation', '--upgrade', '.', '-vv']' returned non-zero exit status 1. ```

I noticed "is required to install pyproject.toml-based projects", so I install pyproject-toml by using pypi

$ conda list | grep -i pyproject
pyproject-toml            0.0.10                   pypi_0    pypi

but still failed with "pip._internal.exceptions.InstallationError: Could not build wheels for legate.core, which is required to install pyproject.toml-based projects" I also noticed include "could not find requested file: rapids-***", dose it mean I have to install rapids?

bryevdv commented 1 year ago

@LUOXIAO92 You don't have to install RAPIDS, but the legate.core build makes use of some of the cmake build tools that were developed for RAPIDS. @trxcllnt will have to chime in about how or if those can be installed separately up front.

manopapad commented 1 year ago

By the way, "If using UCX, a build configured with --enable-mt is required." is written in the BUILD.md https://github.com/nv-legate/legate.core/blob/branch-22.12/BUILD.md . I want to use UCX and add this option at install.py, but fails with "no such option: --enable-mt", what should I do?

I meant that the UCX you provide must be built with --enable-mt. I added a clarification on the documentation.

LUOXIAO92 commented 1 year ago

@LUOXIAO92 You don't have to install RAPIDS, but the legate.core build makes use of some of the cmake build tools that were developed for RAPIDS. @trxcllnt will have to chime in about how or if those can be installed separately up front.

Thanks. It will be great help if legate.core can be builded without internet.

LUOXIAO92 commented 1 year ago

By the way, "If using UCX, a build configured with --enable-mt is required." is written in the BUILD.md https://github.com/nv-legate/legate.core/blob/branch-22.12/BUILD.md . I want to use UCX and add this option at install.py, but fails with "no such option: --enable-mt", what should I do?

I meant that the UCX you provide must be built with --enable-mt. I added a clarification on the documentation.

Thank you