search

NVIDIA / TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
https://nvidia.github.io/TensorRT-LLM
Apache License 2.0
7.34k stars 794 forks source link

pip3 install tensorrt_llm-0.8.0-cp310-cp310-linux_x86_64.whl Bad param #1804

Closed najsword closed 1 week ago

najsword commented 1 week ago

Collecting nvidia-ammo~=0.7.0 (from tensorrt-llm==0.8.0) Using cached nvidia-ammo-0.7.4.tar.gz (6.9 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [6 lines of output] Traceback (most recent call last): File "", line 2, in File "", line 34, in File "/tmp/pip-install-t8atiqhs/nvidia-ammo_8f3b1a4dfa1c43088155976cbbc6fd2f/setup.py", line 90, in raise RuntimeError("Bad params") RuntimeError: Bad params [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed

× Encountered error while generating package metadata. ╰─> See above for output.

note: This is an issue with the package mentioned above, not pip. hint: See above for details.

How to solove it?

hijkzzz commented 1 week ago

Installing older versions < 0.10 is not recommended please pip install tensorrt_llm==0.11.0.dev2024061800 or pip install tensorrt_llm== 0.10.0

najsword commented 1 week ago

Installing older versions < 0.10 is not recommended please pip install tensorrt_llm==0.11.0.dev2024061800 or pip install tensorrt_llm== 0.10.0

just for so many people has verified with v.0.8.0. say: thats easy to build