Closed OPPEYRADY closed 6 months ago
Trying to build from source using WSL2 on Ubuntu-20.04 Is there something I'm doing wrong or missing?
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://pypi.ngc.nvidia.com, https://download.pytorch.org/whl/cu121, https://pypi.nvidia.com Collecting accelerate==0.25.0 (from -r requirements.txt (line 3)) Obtaining dependency information for accelerate==0.25.0 from https://files.pythonhosted.org/packages/f7/fc/c55e5a2da345c9a24aa2e1e0f60eb2ca290b6a41be82da03a6d4baec4f99/accelerate-0.25.0-py3-none-any.whl.metadata Downloading accelerate-0.25.0-py3-none-any.whl.metadata (18 kB) Collecting build (from -r requirements.txt (line 4)) Obtaining dependency information for build from https://files.pythonhosted.org/packages/93/dd/b464b728b866aaa62785a609e0dd8c72201d62c5f7c53e7c20f4dceb085f/build-1.0.3-py3-none-any.whl.metadata Downloading build-1.0.3-py3-none-any.whl.metadata (4.2 kB) Collecting colored (from -r requirements.txt (line 5)) Obtaining dependency information for colored from https://files.pythonhosted.org/packages/75/d1/548f697f88872321525e294f8863efbdd1c313964b7f94e49ab0dc4f2895/colored-2.2.4-py3-none-any.whl.metadata Downloading colored-2.2.4-py3-none-any.whl.metadata (3.6 kB) Collecting cuda-python==12.2.0 (from -r requirements.txt (line 6)) Obtaining dependency information for cuda-python==12.2.0 from https://files.pythonhosted.org/packages/2b/5c/ad3b6bee78f95134834dc2ce8805fc12ac70d7a9ba065e2d7c05263549dc/cuda_python-12.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading cuda_python-12.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (749 bytes) Collecting diffusers==0.15.0 (from -r requirements.txt (line 7)) Obtaining dependency information for diffusers==0.15.0 from https://files.pythonhosted.org/packages/13/43/d4ae69ba5f503d58c7aef13f0f93d9c84694652dc2a16f8ea3d8246ebe95/diffusers-0.15.0-py3-none-any.whl.metadata Downloading diffusers-0.15.0-py3-none-any.whl.metadata (19 kB) Collecting lark (from -r requirements.txt (line 8)) Obtaining dependency information for lark from https://files.pythonhosted.org/packages/e7/9c/eef7c591e6dc952f3636cfe0df712c0f9916cedf317810a3bb53ccb65cdd/lark-1.1.9-py3-none-any.whl.metadata Downloading lark-1.1.9-py3-none-any.whl.metadata (1.9 kB) Requirement already satisfied: mpi4py in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 9)) (3.1.5) Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 10)) (1.22.2) Requirement already satisfied: onnx>=1.12.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 11)) (1.14.0) Requirement already satisfied: polygraphy in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 12)) (0.48.1) Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 13)) (5.9.4) Collecting pynvml>=11.5.0 (from -r requirements.txt (line 14)) Obtaining dependency information for pynvml>=11.5.0 from https://files.pythonhosted.org/packages/5b/9c/adb8070059caaa15d5a572b66bccd95900d8c1b9fa54d6ecea6ae97448d1/pynvml-11.5.0-py3-none-any.whl.metadata Downloading pynvml-11.5.0-py3-none-any.whl.metadata (7.8 kB) Collecting sentencepiece>=0.1.99 (from -r requirements.txt (line 15)) Obtaining dependency information for sentencepiece>=0.1.99 from https://files.pythonhosted.org/packages/a6/27/33019685023221ca8ed98e8ceb7ae5e166032686fa3662c68f1f1edf334e/sentencepiece-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading sentencepiece-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB) Requirement already satisfied: tensorrt==9.2.0.post12.dev5 in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 16)) (9.2.0.post12.dev5) Requirement already satisfied: torch in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 17)) (2.1.0a0+32f93b1) Collecting nvidia-ammo~=0.5.0 (from -r requirements.txt (line 18)) Downloading https://pypi.nvidia.com/nvidia-ammo/nvidia_ammo-0.5.1-cp310-cp310-linux_x86_64.whl (943 kB) ââââââââââââââââââââââââââââââââââââââ 943.2/943.2 kB 12.2 MB/s eta 0:00:00 Collecting transformers==4.36.1 (from -r requirements.txt (line 19)) Obtaining dependency information for transformers==4.36.1 from https://files.pythonhosted.org/packages/fc/04/0aad491cd98b09236c54ab849863ee85421eeda5138bbf9d33ecc594652b/transformers-4.36.1-py3-none-any.whl.metadata Downloading transformers-4.36.1-py3-none-any.whl.metadata (126 kB) âââââââââââââââââââââââââââââââââââââââ 126.8/126.8 kB 4.3 MB/s eta 0:00:00 Requirement already satisfied: wheel in /usr/local/lib/python3.10/dist-packages (from -r requirements.txt (line 20)) (0.41.2) Collecting optimum (from -r requirements.txt (line 21)) Obtaining dependency information for optimum from https://files.pythonhosted.org/packages/5d/7a/1cc655edf289cdb533b0ea1d2f382d344248a53ad21eb8e34deb4551684b/optimum-1.17.1-py3-none-any.whl.metadata Downloading optimum-1.17.1-py3-none-any.whl.metadata (18 kB) Collecting evaluate (from -r requirements.txt (line 22)) Obtaining dependency information for evaluate from https://files.pythonhosted.org/packages/70/63/7644a1eb7b0297e585a6adec98ed9e575309bb973c33b394dae66bc35c69/evaluate-0.4.1-py3-none-any.whl.metadata Downloading evaluate-0.4.1-py3-none-any.whl.metadata (9.4 kB) Collecting janus (from -r requirements.txt (line 23)) Downloading janus-1.0.0-py3-none-any.whl (6.9 kB) Collecting datasets (from -r requirements-dev.txt (line 2)) Obtaining dependency information for datasets from https://files.pythonhosted.org/packages/73/75/ead8e4489217835fd8004c9c89dad8217deacd7e2591340dbe249b58c29f/datasets-2.17.1-py3-none-any.whl.metadata Downloading datasets-2.17.1-py3-none-any.whl.metadata (20 kB) Requirement already satisfied: einops in /usr/local/lib/python3.10/dist-packages (from -r requirements-dev.txt (line 3)) (0.7.0) Collecting graphviz (from -r requirements-dev.txt (line 5)) Downloading graphviz-0.20.1-py3-none-any.whl (47 kB) ââââââââââââââââââââââââââââââââââââââââ 47.0/47.0 kB 20.6 MB/s eta 0:00:00 Collecting mypy (from -r requirements-dev.txt (line 6)) Obtaining dependency information for mypy from https://files.pythonhosted.org/packages/f1/48/e78aa47176bf7c24beb321031043d7c9c99035d816a6eca32d13cc59736f/mypy-1.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading mypy-1.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.8 kB) Collecting parameterized (from -r requirements-dev.txt (line 7)) Obtaining dependency information for parameterized from https://files.pythonhosted.org/packages/00/2f/804f58f0b856ab3bf21617cccf5b39206e6c4c94c2cd227bde125ea6105f/parameterized-0.9.0-py2.py3-none-any.whl.metadata Downloading parameterized-0.9.0-py2.py3-none-any.whl.metadata (18 kB) Collecting pre-commit (from -r requirements-dev.txt (line 8)) Obtaining dependency information for pre-commit from https://files.pythonhosted.org/packages/f8/7c/f7a50d07ae9fa86d2149d4acb2daf61e7c0257b56bc1a24a7fb09c1b70df/pre_commit-3.6.2-py2.py3-none-any.whl.metadata Downloading pre_commit-3.6.2-py2.py3-none-any.whl.metadata (1.3 kB) Collecting pybind11-stubgen (from -r requirements-dev.txt (line 9)) Obtaining dependency information for pybind11-stubgen from https://files.pythonhosted.org/packages/59/cf/8bf34dd8204b73916eb231e68141936de65832f43ece3a22fda51c4685a8/pybind11_stubgen-2.4.2-py3-none-any.whl.metadata Downloading pybind11_stubgen-2.4.2-py3-none-any.whl.metadata (1.7 kB) Collecting pytest-cov (from -r requirements-dev.txt (line 10)) Obtaining dependency information for pytest-cov from https://files.pythonhosted.org/packages/a7/4b/8b78d126e275efa2379b1c2e09dc52cf70df16fc3b90613ef82531499d73/pytest_cov-4.1.0-py3-none-any.whl.metadata Downloading pytest_cov-4.1.0-py3-none-any.whl.metadata (26 kB) Collecting pytest-forked (from -r requirements-dev.txt (line 11)) Obtaining dependency information for pytest-forked from https://files.pythonhosted.org/packages/f4/af/9c0bda43e486a3c9bf1e0f876d0f241bc3f229d7d65d09331a0868db9629/pytest_forked-1.6.0-py3-none-any.whl.metadata Downloading pytest_forked-1.6.0-py3-none-any.whl.metadata (3.5 kB) Requirement already satisfied: pytest-xdist in /usr/local/lib/python3.10/dist-packages (from -r requirements-dev.txt (line 12)) (3.3.1) Collecting rouge_score (from -r requirements-dev.txt (line 13)) Downloading rouge_score-0.1.2.tar.gz (17 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting typing-extensions==4.8.0 (from -r requirements-dev.txt (line 14)) Downloading https://download.pytorch.org/whl/typing_extensions-4.8.0-py3-none-any.whl (31 kB) Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from accelerate==0.25.0->-r requirements.txt (line 3)) (23.1) Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from accelerate==0.25.0->-r requirements.txt (line 3)) (6.0.1) Collecting huggingface-hub (from accelerate==0.25.0->-r requirements.txt (line 3)) Obtaining dependency information for huggingface-hub from https://files.pythonhosted.org/packages/28/03/7d3c7153113ec59cfb31e3b8ee773f5f420a0dd7d26d40442542b96675c3/huggingface_hub-0.20.3-py3-none-any.whl.metadata Downloading huggingface_hub-0.20.3-py3-none-any.whl.metadata (12 kB) Collecting safetensors>=0.3.1 (from accelerate==0.25.0->-r requirements.txt (line 3)) Obtaining dependency information for safetensors>=0.3.1 from https://files.pythonhosted.org/packages/d0/ba/b2254fafc7f5fdc98a2fa4d5a5eeb029fbf9589ec87f2c230c3ac0a1dd53/safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB) Requirement already satisfied: cython in /usr/local/lib/python3.10/dist-packages (from cuda-python==12.2.0->-r requirements.txt (line 6)) (3.0.3) Requirement already satisfied: Pillow in /usr/local/lib/python3.10/dist-packages (from diffusers==0.15.0->-r requirements.txt (line 7)) (9.2.0) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from diffusers==0.15.0->-r requirements.txt (line 7)) (3.12.4) Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.10/dist-packages (from diffusers==0.15.0->-r requirements.txt (line 7)) (6.8.0) Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from diffusers==0.15.0->-r requirements.txt (line 7)) (2023.10.3) Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from diffusers==0.15.0->-r requirements.txt (line 7)) (2.31.0) Collecting tokenizers<0.19,>=0.14 (from transformers==4.36.1->-r requirements.txt (line 19)) Obtaining dependency information for tokenizers<0.19,>=0.14 from https://files.pythonhosted.org/packages/1c/5d/cf5e122ce4f1a29f165b2a69dc33d1ff30bce303343d58a54775ddba5d51/tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB) Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers==4.36.1->-r requirements.txt (line 19)) (4.66.1) Collecting pyproject_hooks (from build->-r requirements.txt (line 4)) Obtaining dependency information for pyproject_hooks from https://files.pythonhosted.org/packages/d5/ea/9ae603de7fbb3df820b23a70f6aff92bf8c7770043254ad8d2dc9d6bcba4/pyproject_hooks-1.0.0-py3-none-any.whl.metadata Downloading pyproject_hooks-1.0.0-py3-none-any.whl.metadata (1.3 kB) Requirement already satisfied: tomli>=1.1.0 in /usr/local/lib/python3.10/dist-packages (from build->-r requirements.txt (line 4)) (2.0.1) Requirement already satisfied: protobuf>=3.20.2 in /usr/local/lib/python3.10/dist-packages (from onnx>=1.12.0->-r requirements.txt (line 11)) (4.24.4) Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch->-r requirements.txt (line 17)) (1.12) Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch->-r requirements.txt (line 17)) (2.6.3) Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch->-r requirements.txt (line 17)) (3.1.2) Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch->-r requirements.txt (line 17)) (2023.6.0) Requirement already satisfied: ninja in /usr/local/lib/python3.10/dist-packages (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (1.11.1.1) Collecting onnxruntime>=1.16.1 (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Obtaining dependency information for onnxruntime>=1.16.1 from https://files.pythonhosted.org/packages/7c/c8/9131986ad60c900af8790dad66d7422b169daa578d6e047798ff02434c48/onnxruntime-1.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata Downloading onnxruntime-1.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (4.2 kB) Collecting onnxsim (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Obtaining dependency information for onnxsim from https://files.pythonhosted.org/packages/da/0b/ba622076ab256e97e3da0febea33df8c90ee6e4c42f34c0213fbcdf74ccd/onnxsim-0.4.35-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading onnxsim-0.4.35-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB) Collecting onnx-graphsurgeon (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Downloading https://developer.download.nvidia.com/compute/redist/onnx-graphsurgeon/onnx_graphsurgeon-0.3.27-py2.py3-none-any.whl (42 kB) âââââââââââââââââââââââââââââââââââââââ 42.1/42.1 kB 366.3 MB/s eta 0:00:00 Requirement already satisfied: scipy in /usr/local/lib/python3.10/dist-packages (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (1.11.1) Collecting torchprofile>=0.0.4 (from nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Downloading torchprofile-0.0.4-py3-none-any.whl (7.7 kB) Collecting coloredlogs (from optimum->-r requirements.txt (line 21)) Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) ââââââââââââââââââââââââââââââââââââââââ 46.0/46.0 kB 67.4 MB/s eta 0:00:00 Collecting transformers[sentencepiece]>=4.26.0 (from optimum->-r requirements.txt (line 21)) Obtaining dependency information for transformers[sentencepiece]>=4.26.0 from https://files.pythonhosted.org/packages/85/f6/c5065913119c41ecad148c34e3a861f719e16b89a522287213698da911fc/transformers-4.37.2-py3-none-any.whl.metadata Downloading transformers-4.37.2-py3-none-any.whl.metadata (129 kB) ââââââââââââââââââââââââââââââââââââââ 129.4/129.4 kB 21.2 MB/s eta 0:00:00 Collecting dill (from evaluate->-r requirements.txt (line 22)) Obtaining dependency information for dill from https://files.pythonhosted.org/packages/c9/7a/cef76fd8438a42f96db64ddaa85280485a9c395e7df3db8158cfec1eee34/dill-0.3.8-py3-none-any.whl.metadata Downloading dill-0.3.8-py3-none-any.whl.metadata (10 kB) Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from evaluate->-r requirements.txt (line 22)) (1.5.3) Collecting xxhash (from evaluate->-r requirements.txt (line 22)) Obtaining dependency information for xxhash from https://files.pythonhosted.org/packages/80/8a/1dd41557883b6196f8f092011a5c1f72d4d44cf36d7b67d4a5efe3127949/xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB) Collecting multiprocess (from evaluate->-r requirements.txt (line 22)) Obtaining dependency information for multiprocess from https://files.pythonhosted.org/packages/bc/f7/7ec7fddc92e50714ea3745631f79bd9c96424cb2702632521028e57d3a36/multiprocess-0.70.16-py310-none-any.whl.metadata Downloading multiprocess-0.70.16-py310-none-any.whl.metadata (7.2 kB) Collecting responses<0.19 (from evaluate->-r requirements.txt (line 22)) Downloading responses-0.18.0-py3-none-any.whl (38 kB) Collecting pyarrow>=12.0.0 (from datasets->-r requirements-dev.txt (line 2)) Obtaining dependency information for pyarrow>=12.0.0 from https://files.pythonhosted.org/packages/d4/ca/ef67abb77f9dd51a0d3ff7fcebff58296068a046d7da352b9548070005ed/pyarrow-15.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata Downloading pyarrow-15.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (3.0 kB) Collecting pyarrow-hotfix (from datasets->-r requirements-dev.txt (line 2)) Obtaining dependency information for pyarrow-hotfix from https://files.pythonhosted.org/packages/e4/f4/9ec2222f5f5f8ea04f66f184caafd991a39c8782e31f5b0266f101cb68ca/pyarrow_hotfix-0.6-py3-none-any.whl.metadata Downloading pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB) Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from datasets->-r requirements-dev.txt (line 2)) (3.8.5) Collecting mypy-extensions>=1.0.0 (from mypy->-r requirements-dev.txt (line 6)) Obtaining dependency information for mypy-extensions>=1.0.0 from https://files.pythonhosted.org/packages/2a/e2/5d3f6ada4297caebe1a2add3b126fe800c96f56dbe5d1988a2cbe0b267aa/mypy_extensions-1.0.0-py3-none-any.whl.metadata Downloading mypy_extensions-1.0.0-py3-none-any.whl.metadata (1.1 kB) Collecting cfgv>=2.0.0 (from pre-commit->-r requirements-dev.txt (line 8)) Obtaining dependency information for cfgv>=2.0.0 from https://files.pythonhosted.org/packages/c5/55/51844dd50c4fc7a33b653bfaba4c2456f06955289ca770a5dbd5fd267374/cfgv-3.4.0-py2.py3-none-any.whl.metadata Downloading cfgv-3.4.0-py2.py3-none-any.whl.metadata (8.5 kB) Collecting identify>=1.0.0 (from pre-commit->-r requirements-dev.txt (line 8)) Obtaining dependency information for identify>=1.0.0 from https://files.pythonhosted.org/packages/f7/c8/78c694ee4a51677c68796ba11aa36004cde895b451eb59fa23b26a600de3/identify-2.5.35-py2.py3-none-any.whl.metadata Downloading identify-2.5.35-py2.py3-none-any.whl.metadata (4.4 kB) Collecting nodeenv>=0.11.1 (from pre-commit->-r requirements-dev.txt (line 8)) Obtaining dependency information for nodeenv>=0.11.1 from https://files.pythonhosted.org/packages/1a/e6/6d2ead760a9ddb35e65740fd5a57e46aadd7b0c49861ab24f94812797a1c/nodeenv-1.8.0-py2.py3-none-any.whl.metadata Downloading nodeenv-1.8.0-py2.py3-none-any.whl.metadata (21 kB) Collecting virtualenv>=20.10.0 (from pre-commit->-r requirements-dev.txt (line 8)) Obtaining dependency information for virtualenv>=20.10.0 from https://files.pythonhosted.org/packages/83/22/54b1180756d2d6194bcafb7425d437c3034c4bff92129c3e1e633079e2c4/virtualenv-20.25.0-py3-none-any.whl.metadata Downloading virtualenv-20.25.0-py3-none-any.whl.metadata (4.5 kB) Requirement already satisfied: pytest>=4.6 in /usr/local/lib/python3.10/dist-packages (from pytest-cov->-r requirements-dev.txt (line 10)) (7.4.2) Collecting coverage[toml]>=5.2.1 (from pytest-cov->-r requirements-dev.txt (line 10)) Obtaining dependency information for coverage[toml]>=5.2.1 from https://files.pythonhosted.org/packages/49/d5/9d66fd984979b58927588efb0398953acbdb4c45eb7cfcd74fa9b8d51d12/coverage-7.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading coverage-7.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.2 kB) Collecting py (from pytest-forked->-r requirements-dev.txt (line 11)) Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) ââââââââââââââââââââââââââââââââââââââââ 98.7/98.7 kB 45.2 MB/s eta 0:00:00 Requirement already satisfied: execnet>=1.1 in /usr/local/lib/python3.10/dist-packages (from pytest-xdist->-r requirements-dev.txt (line 12)) (2.0.2) Requirement already satisfied: absl-py in /usr/local/lib/python3.10/dist-packages (from rouge_score->-r requirements-dev.txt (line 13)) (2.0.0) Collecting nltk (from rouge_score->-r requirements-dev.txt (line 13)) Obtaining dependency information for nltk from https://files.pythonhosted.org/packages/a6/0a/0d20d2c0f16be91b9fa32a77b76c60f9baf6eba419e5ef5deca17af9c582/nltk-3.8.1-py3-none-any.whl.metadata Downloading nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB) Requirement already satisfied: six>=1.14.0 in /usr/local/lib/python3.10/dist-packages (from rouge_score->-r requirements-dev.txt (line 13)) (1.16.0) Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (23.1.0) Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (3.2.0) Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (6.0.4) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (4.0.3) Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (1.9.2) Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (1.4.0) Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets->-r requirements-dev.txt (line 2)) (1.3.1) Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from nodeenv>=0.11.1->pre-commit->-r requirements-dev.txt (line 8)) (68.2.2) Collecting flatbuffers (from onnxruntime>=1.16.1->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Obtaining dependency information for flatbuffers from https://files.pythonhosted.org/packages/6f/12/d5c79ee252793ffe845d58a913197bfa02ae9a0b5c9bc3dc4b58d477b9e7/flatbuffers-23.5.26-py2.py3-none-any.whl.metadata Downloading flatbuffers-23.5.26-py2.py3-none-any.whl.metadata (850 bytes) Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest>=4.6->pytest-cov->-r requirements-dev.txt (line 10)) (2.0.0) Requirement already satisfied: pluggy<2.0,>=0.12 in /usr/local/lib/python3.10/dist-packages (from pytest>=4.6->pytest-cov->-r requirements-dev.txt (line 10)) (1.3.0) Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest>=4.6->pytest-cov->-r requirements-dev.txt (line 10)) (1.1.3) Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->diffusers==0.15.0->-r requirements.txt (line 7)) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->diffusers==0.15.0->-r requirements.txt (line 7)) (1.26.16) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->diffusers==0.15.0->-r requirements.txt (line 7)) (2023.7.22) Requirement already satisfied: torchvision>=0.4 in /usr/local/lib/python3.10/dist-packages (from torchprofile>=0.0.4->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (0.16.0a0) INFO: pip is looking at multiple versions of transformers[sentencepiece] to determine which version is compatible with other requirements. This could take a while. Collecting transformers[sentencepiece]>=4.26.0 (from optimum->-r requirements.txt (line 21)) Obtaining dependency information for transformers[sentencepiece]>=4.26.0 from https://files.pythonhosted.org/packages/ad/67/b4d6a51dcaf988cb45b31e26c6e33fb169fe34ba5fb168b086309bd7c028/transformers-4.37.1-py3-none-any.whl.metadata Downloading transformers-4.37.1-py3-none-any.whl.metadata (129 kB) ââââââââââââââââââââââââââââââââââââââ 129.4/129.4 kB 30.0 MB/s eta 0:00:00 Obtaining dependency information for transformers[sentencepiece]>=4.26.0 from https://files.pythonhosted.org/packages/3c/45/52133ce6bce49a099cc865599803bf1fad93de887276f728e56848d77a70/transformers-4.37.0-py3-none-any.whl.metadata Downloading transformers-4.37.0-py3-none-any.whl.metadata (129 kB) ââââââââââââââââââââââââââââââââââââââ 129.4/129.4 kB 31.8 MB/s eta 0:00:00 Obtaining dependency information for transformers[sentencepiece]>=4.26.0 from https://files.pythonhosted.org/packages/20/0a/739426a81f7635b422fbe6cb8d1d99d1235579a6ac8024c13d743efa6847/transformers-4.36.2-py3-none-any.whl.metadata Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB) ââââââââââââââââââââââââââââââââââââââ 126.8/126.8 kB 31.9 MB/s eta 0:00:00 Collecting distlib<1,>=0.3.7 (from virtualenv>=20.10.0->pre-commit->-r requirements-dev.txt (line 8)) Obtaining dependency information for distlib<1,>=0.3.7 from https://files.pythonhosted.org/packages/8e/41/9307e4f5f9976bc8b7fea0b66367734e8faf3ec84bc0d412d8cfabbb66cd/distlib-0.3.8-py2.py3-none-any.whl.metadata Downloading distlib-0.3.8-py2.py3-none-any.whl.metadata (5.1 kB) Requirement already satisfied: platformdirs<5,>=3.9.1 in /usr/local/lib/python3.10/dist-packages (from virtualenv>=20.10.0->pre-commit->-r requirements-dev.txt (line 8)) (3.11.0) Collecting humanfriendly>=9.1 (from coloredlogs->optimum->-r requirements.txt (line 21)) Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB) ââââââââââââââââââââââââââââââââââââââââ 86.8/86.8 kB 34.5 MB/s eta 0:00:00 Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.10/dist-packages (from importlib-metadata->diffusers==0.15.0->-r requirements.txt (line 7)) (3.16.2) Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch->-r requirements.txt (line 17)) (2.1.3) Requirement already satisfied: click in /usr/local/lib/python3.10/dist-packages (from nltk->rouge_score->-r requirements-dev.txt (line 13)) (8.1.6) Requirement already satisfied: joblib in /usr/local/lib/python3.10/dist-packages (from nltk->rouge_score->-r requirements-dev.txt (line 13)) (1.3.2) Collecting rich (from onnxsim->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) Obtaining dependency information for rich from https://files.pythonhosted.org/packages/be/be/1520178fa01eabe014b16e72a952b9f900631142ccd03dc36cf93e30c1ce/rich-13.7.0-py3-none-any.whl.metadata Downloading rich-13.7.0-py3-none-any.whl.metadata (18 kB) Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->evaluate->-r requirements.txt (line 22)) (2.8.2) Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->evaluate->-r requirements.txt (line 22)) (2023.3) Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch->-r requirements.txt (line 17)) (1.3.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from rich->onnxsim->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.10/dist-packages (from rich->onnxsim->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (2.16.1) Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py>=2.2.0->rich->onnxsim->nvidia-ammo~=0.5.0->-r requirements.txt (line 18)) (0.1.2) Downloading accelerate-0.25.0-py3-none-any.whl (265 kB) ââââââââââââââââââââââââââââââââââââââââ 265.7/265.7 kB 15.0 MB/s eta 0:00:00 Downloading cuda_python-12.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20.1 MB) ââââââââââââââââââââââââââââââââââââââââ 20.1/20.1 MB 51.7 MB/s eta 0:00:00 Downloading diffusers-0.15.0-py3-none-any.whl (851 kB) ââââââââââââââââââââââââââââââââââââââââ 851.8/851.8 kB 76.5 MB/s eta 0:00:00 Downloading transformers-4.36.1-py3-none-any.whl (8.3 MB) ââââââââââââââââââââââââââââââââââââââââ 8.3/8.3 MB 71.0 MB/s eta 0:00:00 Downloading build-1.0.3-py3-none-any.whl (18 kB) Downloading colored-2.2.4-py3-none-any.whl (16 kB) Downloading lark-1.1.9-py3-none-any.whl (111 kB) âââââââââââââââââââââââââââââââââââââââ 111.7/111.7 kB 217.5 MB/s eta 0:00:00 Downloading pynvml-11.5.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.1/53.1 kB 384.8 MB/s eta 0:00:00 Downloading sentencepiece-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ââââââââââââââââââââââââââââââââââââââââ 1.3/1.3 MB 95.9 MB/s eta 0:00:00 Downloading optimum-1.17.1-py3-none-any.whl (407 kB) ââââââââââââââââââââââââââââââââââââââââ 407.1/407.1 kB 79.0 MB/s eta 0:00:00 Downloading evaluate-0.4.1-py3-none-any.whl (84 kB) ââââââââââââââââââââââââââââââââââââââââ 84.1/84.1 kB 78.6 MB/s eta 0:00:00 Downloading datasets-2.17.1-py3-none-any.whl (536 kB) ââââââââââââââââââââââââââââââââââââââââ 536.7/536.7 kB 78.8 MB/s eta 0:00:00 Downloading mypy-1.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.5 MB) ââââââââââââââââââââââââââââââââââââââââ 12.5/12.5 MB 86.0 MB/s eta 0:00:00 Downloading parameterized-0.9.0-py2.py3-none-any.whl (20 kB) Downloading pre_commit-3.6.2-py2.py3-none-any.whl (204 kB) ââââââââââââââââââââââââââââââââââââââââ 204.2/204.2 kB 86.0 MB/s eta 0:00:00 Downloading pybind11_stubgen-2.4.2-py3-none-any.whl (29 kB) Downloading pytest_cov-4.1.0-py3-none-any.whl (21 kB) Downloading pytest_forked-1.6.0-py3-none-any.whl (4.9 kB) Downloading cfgv-3.4.0-py2.py3-none-any.whl (7.2 kB) Downloading dill-0.3.8-py3-none-any.whl (116 kB) ââââââââââââââââââââââââââââââââââââââââ 116.3/116.3 kB 24.2 MB/s eta 0:00:00 Downloading huggingface_hub-0.20.3-py3-none-any.whl (330 kB) ââââââââââââââââââââââââââââââââââââââââ 330.1/330.1 kB 71.2 MB/s eta 0:00:00 Downloading identify-2.5.35-py2.py3-none-any.whl (98 kB) ââââââââââââââââââââââââââââââââââââââââ 98.9/98.9 kB 64.9 MB/s eta 0:00:00 Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) Downloading nodeenv-1.8.0-py2.py3-none-any.whl (22 kB) Downloading onnxruntime-1.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.8 MB) ââââââââââââââââââââââââââââââââââââââââ 6.8/6.8 MB 89.6 MB/s eta 0:00:00 Downloading pyarrow-15.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (38.3 MB) ââââââââââââââââââââââââââââââââââââââââ 38.3/38.3 MB 88.3 MB/s eta 0:00:00 Downloading safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ââââââââââââââââââââââââââââââââââââââââ 1.3/1.3 MB 94.9 MB/s eta 0:00:00 Downloading tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB) ââââââââââââââââââââââââââââââââââââââââ 3.6/3.6 MB 93.8 MB/s eta 0:00:00 Downloading virtualenv-20.25.0-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 91.8 MB/s eta 0:00:00 Downloading multiprocess-0.70.16-py310-none-any.whl (134 kB) âââââââââââââââââââââââââââââââââââââââ 134.8/134.8 kB 188.4 MB/s eta 0:00:00 Downloading nltk-3.8.1-py3-none-any.whl (1.5 MB) ââââââââââââââââââââââââââââââââââââââââ 1.5/1.5 MB 96.3 MB/s eta 0:00:00 Downloading onnxsim-0.4.35-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) ââââââââââââââââââââââââââââââââââââââââ 2.2/2.2 MB 89.7 MB/s eta 0:00:00 Downloading pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Downloading xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB) ââââââââââââââââââââââââââââââââââââââââ 194.1/194.1 kB 81.2 MB/s eta 0:00:00 Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) ââââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 68.6 MB/s eta 0:00:00 Downloading coverage-7.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (233 kB) ââââââââââââââââââââââââââââââââââââââââ 234.0/234.0 kB 74.2 MB/s eta 0:00:00 Downloading flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) Downloading rich-13.7.0-py3-none-any.whl (240 kB) ââââââââââââââââââââââââââââââââââââââââ 240.6/240.6 kB 78.9 MB/s eta 0:00:00 Building wheels for collected packages: rouge_score Building wheel for rouge_score (setup.py): started Building wheel for rouge_score (setup.py): finished with status 'done' Created wheel for rouge_score: filename=rouge_score-0.1.2-py3-none-any.whl size=24952 sha256=e5b89c70f4d52e87f38377f3f8a7298630f3b6f007435fb4506402ef6b64c4cf Stored in directory: /tmp/pip-ephem-wheel-cache-afsavn1h/wheels/5f/dd/89/461065a73be61a532ff8599a28e9beef17985c9e9c31e541b4 Successfully built rouge_score Installing collected packages: sentencepiece, flatbuffers, distlib, xxhash, virtualenv, typing-extensions, safetensors, pyproject_hooks, pynvml, pybind11-stubgen, pyarrow-hotfix, pyarrow, py, parameterized, nodeenv, nltk, mypy-extensions, lark, identify, humanfriendly, graphviz, dill, cuda-python, coverage, colored, cfgv, rouge_score, rich, responses, pytest-forked, pre-commit, mypy, multiprocess, janus, huggingface-hub, coloredlogs, build, tokenizers, pytest-cov, onnxsim, onnxruntime, onnx-graphsurgeon, diffusers, accelerate, transformers, torchprofile, datasets, nvidia-ammo, evaluate, optimum Attempting uninstall: typing-extensions Found existing installation: typing_extensions 4.7.1 Uninstalling typing_extensions-4.7.1: Successfully uninstalled typing_extensions-4.7.1 Attempting uninstall: pynvml Found existing installation: pynvml 11.4.1 Uninstalling pynvml-11.4.1: Successfully uninstalled pynvml-11.4.1 Attempting uninstall: pyarrow Found existing installation: pyarrow 11.0.0 Uninstalling pyarrow-11.0.0: Successfully uninstalled pyarrow-11.0.0 Attempting uninstall: cuda-python Found existing installation: cuda-python 12.2.0rc5+5.g84845d1 Uninstalling cuda-python-12.2.0rc5+5.g84845d1: Successfully uninstalled cuda-python-12.2.0rc5+5.g84845d1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. dask-cuda 23.8.0 requires pynvml<11.5,>=11.0.0, but you have pynvml 11.5.0 which is incompatible. torch-tensorrt 0.0.0 requires tensorrt<8.7,>=8.6, but you have tensorrt 9.2.0.post12.dev5 which is incompatible. Successfully installed accelerate-0.25.0 build-1.0.3 cfgv-3.4.0 colored-2.2.4 coloredlogs-15.0.1 coverage-7.4.1 cuda-python-12.2.0 datasets-2.17.1 diffusers-0.15.0 dill-0.3.8 distlib-0.3.8 evaluate-0.4.1 flatbuffers-23.5.26 graphviz-0.20.1 huggingface-hub-0.20.3 humanfriendly-10.0 identify-2.5.35 janus-1.0.0 lark-1.1.9 multiprocess-0.70.16 mypy-1.8.0 mypy-extensions-1.0.0 nltk-3.8.1 nodeenv-1.8.0 nvidia-ammo-0.5.1 onnx-graphsurgeon-0.3.27 onnxruntime-1.17.0 onnxsim-0.4.35 optimum-1.17.1 parameterized-0.9.0 pre-commit-3.6.2 py-1.11.0 pyarrow-15.0.0 pyarrow-hotfix-0.6 pybind11-stubgen-2.4.2 pynvml-11.5.0 pyproject_hooks-1.0.0 pytest-cov-4.1.0 pytest-forked-1.6.0 responses-0.18.0 rich-13.7.0 rouge_score-0.1.2 safetensors-0.4.2 sentencepiece-0.2.0 tokenizers-0.15.2 torchprofile-0.0.4 transformers-4.36.1 typing-extensions-4.8.0 virtualenv-20.25.0 xxhash-3.4.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.2.1 -> 24.0 [notice] To update, run: python3 -m pip install --upgrade pip -- The CXX compiler identification is GNU 11.4.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- NVTX is disabled -- Importing batch manager -- Building PyTorch -- Building Google tests -- Building benchmarks -- Looking for a CUDA compiler -- Looking for a CUDA compiler - /usr/local/cuda/bin/nvcc -- CUDA compiler: /usr/local/cuda/bin/nvcc -- GPU architectures: 90-real;89-real -- The C compiler identification is GNU 11.4.0 -- The CUDA compiler identification is NVIDIA 12.2.140 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CUDA compiler ABI info -- Detecting CUDA compiler ABI info - done -- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped -- Detecting CUDA compile features -- Detecting CUDA compile features - done -- Found CUDAToolkit: /usr/local/cuda/include (found version "12.2.140") -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success -- Found Threads: TRUE -- CUDA library status: -- version: 12.2.140 -- libraries: /usr/local/cuda/lib64 -- include path: /usr/local/cuda/targets/x86_64-linux/include -- ========================= Importing and creating target nvinfer ========================== -- Looking for library nvinfer -- Library that was found /usr/local/tensorrt/targets/x86_64-linux-gnu/lib/libnvinfer.so -- ========================================================================================== -- CUDAToolkit_VERSION 12.2 is greater or equal than 11.0, enable -DENABLE_BF16 flag -- CUDAToolkit_VERSION 12.2 is greater or equal than 11.8, enable -DENABLE_FP8 flag -- Found MPI_C: /opt/hpcx/ompi/lib/libmpi.so (found version "3.1") -- Found MPI_CXX: /opt/hpcx/ompi/lib/libmpi.so (found version "3.1") -- Found MPI: TRUE (found version "3.1") -- COMMON_HEADER_DIRS: /src/tensorrt_llm/cpp;/usr/local/cuda/include -- Found Python3: /usr/bin/python3.10 (found version "3.10.12") found components: Interpreter Development Development.Module Development.Embed -- USE_CXX11_ABI is set by python Torch to 1 CMake Warning at CMakeLists.txt:304 (message): Ignoring environment variable TORCH_CUDA_ARCH_LIST=5.2 6.0 6.1 7.0 7.2 7.5 8.0 8.6 8.7 9.0+PTX -- TORCH_CUDA_ARCH_LIST: 9.0;8.9 -- Found Python executable at /usr/bin/python3.10 -- Found Python libraries at /usr/lib/x86_64-linux-gnu -- Found CUDA: /usr/local/cuda (found version "12.2") -- Found CUDAToolkit: /usr/local/cuda/include (found version "12.2.140") -- Caffe2: CUDA detected: 12.2 -- Caffe2: CUDA nvcc is: /usr/local/cuda/bin/nvcc -- Caffe2: CUDA toolkit directory: /usr/local/cuda -- Caffe2: Header version is: 12.2 -- /usr/local/cuda-12.2/targets/x86_64-linux/lib/libnvrtc.so shorthash is 000ca627 CMake Warning (dev) at /usr/local/lib/python3.10/dist-packages/cmake/data/share/cmake-3.27/Modules/FindPackageHandleStandardArgs.cmake:438 (message): The package name passed to `find_package_handle_standard_args` (nvtx3) does not match the name of the calling package (Caffe2). This can lead to problems in calling code that expects `find_package` result variables (e.g., `_FOUND`) to follow a certain pattern. Call Stack (most recent call first): /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Caffe2/public/cuda.cmake:216 (find_package_handle_standard_args) /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:87 (include) /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package) CMakeLists.txt:337 (find_package) This warning is for project developers. Use -Wno-dev to suppress it. -- Found nvtx3: /usr/local/cuda/include -- USE_CUDNN is set to 0. Compiling without cuDNN support -- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support -- Added CUDA NVCC flags for: -gencode;arch=compute_90,code=sm_90;-gencode;arch=compute_89,code=sm_89 CMake Warning at /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message): static library kineto_LIBRARY-NOTFOUND not found. Call Stack (most recent call first): /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found) CMakeLists.txt:337 (find_package) -- Found Torch: /usr/local/lib/python3.10/dist-packages/torch/lib/libtorch.so -- TORCH_CXX_FLAGS: -D_GLIBCXX_USE_CXX11_ABI=1 -- Building for TensorRT version: 9.2.0, library version: 9 -- Using MPI_C_INCLUDE_DIRS: /opt/hpcx/ompi/include;/opt/hpcx/ompi/include/openmpi;/opt/hpcx/ompi/include/openmpi/opal/mca/hwloc/hwloc201/hwloc/include;/opt/hpcx/ompi/include/openmpi/opal/mca/event/libevent2022/libevent;/opt/hpcx/ompi/include/openmpi/opal/mca/event/libevent2022/libevent/include -- Using MPI_C_LIBRARIES: /opt/hpcx/ompi/lib/libmpi.so -- CMAKE_SYSTEM_PROCESSOR: x86_64 -- Operating System: ubuntu, 22.04 CMake Error at tensorrt_llm/CMakeLists.txt:105 (message): The batch manager library is truncated or incomplete. This is usually caused by using Git LFS (Large File Storage) incorrectly. Please try running command `git lfs install && git lfs pull`. -- Configuring incomplete, errors occurred! Traceback (most recent call last): File "/src/tensorrt_llm/scripts/build_wheel.py", line 306, in <module> main(**vars(args)) File "/src/tensorrt_llm/scripts/build_wheel.py", line 160, in main build_run( File "/usr/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'cmake -DCMAKE_BUILD_TYPE="Release" -DBUILD_PYT="ON" -DBUILD_PYBIND="OFF" "-DCMAKE_CUDA_ARCHITECTURES=90-real;89-real" -DTRT_LIB_DIR=/usr/local/tensorrt/targets/x86_64-linux-gnu/lib -DTRT_INCLUDE_DIR=/usr/local/tensorrt/include -S "/src/tensorrt_llm/cpp"' returned non-zero exit status 1.
Trying to build from source using WSL2 on Ubuntu-20.04 Is there something I'm doing wrong or missing?