-
I tried changing the resolution while using TensorRT, but the generation didn't work well. I also rebuilt ONNX and engines, but I couldn't change the resolution.
How do I solve this problem?
-
Hi,
When running benchmarking with GPU and ort_tensorrt backend: `./bench_model.sh ./stsb-xlm-r-multilingual.bert.opt.onnx --repeat=100 --number=1 --warmup=10 --device=gpu --ort-tensorrt`, I got th…
-
when I convert chatglm2-6b with A10, there is error as below:
Traceback (most recent call last):
File "/code/tensorrt-llm/tensorrt-llm/TensorRT-LLM/examples/chatglm/build.py", line 895, in
r…
-
## Description
**I want to use tensorrt with my mxnet, i compile the mxnet with the source code. when I add the flag cmake -D USE_TENSORRT=1, i report compile error like this:**
CMake Error at /home…
-
## Description
Sphinx builds of the Python API docs have the following warning(s):
```
/work/mxnet/docs/python_docs/python/build/tutorials/performance/backend/tensorrt/tensorrt.ipynb:272: WARNING…
-
-
## Description
The docker image mxnet/tensorrt which integrates mxnet with tensorrt core dumps. docker image has TRT 4.0, python3.5, cuda9 and MxNet 1.3.
## Environment info (Required)
AWS base…
-
**Star RTDETR**
请先在RTDETR主页点击**star**以支持本项目
Star RTDETR to help more people discover this project.
---
**Describe the bug**
![image](https://github.com/user-attachments/assets/9b374f22-a98…
-
### System Info
GPU 2* A30, TRT-LLM branch main, commid id: 66ef1df492f7bc9c8eeb01d7e14db01838e3f0bd
### Who can help?
_No response_
### Information
- [x] The official example scripts
- [ ] …
-
### System Info
- OS: Ubuntu 22.04.4 LTS
- Nvidia driver version: 545.23.08
- CPU architecture: x86
- RAM size: ~500GB
- GPUs: 2xL40s 48GB
- Docker container image: manually compiled tensorrtllm…