-
## What
I am trying to export a model that contains `nn.InstanceNorm2d` (the call from the module can be found [here](https://github.com/princeton-vl/RAFT/blob/3fa0bb0a9c633ea0a9bb8a79c576b6785d4e6a0…
-
## 环境
- 【FastDeploy版本】：fastdeploy-linux-gpu-0.0.0
- 【系统平台】: Linux x64 (Ubuntu 20.04)
- 【硬件】： Nvidia GPU 4060Ti, conda-forge: CUDA 11.7, CUDNN 8.4
- 【编译语言】： Python (3.10）
## 性能疑问
- FastDe…
-
[NVINFER LOG]: 1: [stdArchiveReader.cpp::StdArchiveReader::32] Error Code 1: Serialization (Serialization assertion magicTagRead == kMAGIC_TAG failed.Magic tag does not match)
[NVINFER LOG]: 4: [runt…
-
### System Info
CPU architecture: x86_64
GPU: 8 NVIDIA H100
Libraries
TensorRT-LLM: v0.12.0
TensorRT: 10.3.0
Modelopt: 0.1.1
CUDA: 12.4
NVIDIA driver version: 550.90.12
### Who can help?
_No respon…
-
### System Info
- GPU： NVIDIA H100 80G
- TensorRT-LLM branch main
- TensorRT-LLM commit: 8681b3a4c0ccc1028bb48d83aacbb690af8f55e7
### Who can help?
@byshiue
### Information
- [x] The official ex…
-
**Is your feature request related to a problem? Please describe.**
SDXL is slow, we can speed up the process using TensorRT
**Describe the idea you'd like**
Please support tensorRT, it can reduce…
-
## Description
## Environment
I'm using this docker image: nvcr.io/nvidia/tensorrt:24.08-py3
**TensorRT Version**:
**NVIDIA GPU**: L40S
**NVIDIA Driver Version**: 535.183.01
**CUDA Version*…
-
Hello，i convert the official pretrained model to the onnx model by
`yolo export model=jameslahm/yolov10{n/s/m/b/l/x} format=onnx opset=13 simplify`
Then, i convert the onnx to the tensorRT-fp16 i…
-
```
==== backtrace (tid:1508653) ==== …
-
### System Info
```shell
optimum: 1.20.0
os: ubuntu 20.04 with RTX 2080TI
python: 3.10.14
```
### Who can help?
@michaelbenayoun @JingyaHuang @echarlaix
### Information
- [X] The…