-
Simply try it yourself. Try to install the `tensorrt` Python package. The instructions do not work. The contents of `tensorrt_bindings`'s `__init__.py` doesn't make sense.
-
### System Info
- TensorRT-LLM version: 0.11.0
- Python Version: CPython 3.12.3
- Operating System: Linux 6.8.0-1012-aws
- CPU Architecture: x86_64
- Driver Version: 560.35
- CUDA Version: 12.6
### …
-
### System Info
```shell
optimum: 1.20.0
os: ubuntu 20.04 with RTX 2080TI
python: 3.10.14
```
### Who can help?
@michaelbenayoun @JingyaHuang @echarlaix
### Information
- [X] The…
-
https://github.com/k2-fsa/sherpa/tree/master/triton/scripts
Have checked the scripts here but only conformer trt script (triton/scripts/build_librispeech_pruned_transducer_stateless3_offline_trt.sh)…
-
### Describe the issue
I'm exporting an nnUNetV2 model from torch to onnx fromat using torch.dynamo_export. I can launch the model with onnxruntime on the CPUExecutionProvider as well as the CUDAExec…
-
Attempting to build an engine using fp8_rowwise fails on 4090 GPUs with the message:
`[TensorRT-LLM Error][CutlassFp8RowwiseGemmRunner][GEMM Dispatch] Arch unsupported for CUTLASS gated GEMM`.
I've …
-
Hi, thank for great work!
When I try to build and run the yolo-world tensorrt model on nvidia orin nx(with cuda11.4 and tensorrt8.5.2), i meet a mistake. It's output score all became 100%. When i tes…
-
thanks for your great work,i have compiled this rep https://github.com/cyrusbehr/tensorrt-cpp-api?tab=readme-ov-file and this https://github.com/cyrusbehr/YOLOv8-TensorRT-CPP/issues/new. fortunately .…
-
## Description
I am trying to follow the steps here https://github.com/NVIDIA/TensorRT/blob/release/8.6/README.md
and lauch the tensorrt oss. I am getting the below issue
`sudo ./launch.sh --tag ten…
-
Pls, add new tensorrt libraly for easy installing TensorRT
```Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f2.0.1v1.10.1-previous-218-g643a485d
…