NVIDIA TensorRT issues - Githubissues

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

https://developer.nvidia.com/tensorrt

Apache License 2.0

10.13k stars 2.07k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

TensorRT is encountering issues with models quantized using pytorch-quantization.

#3976 wjx10210 opened 56 minutes ago
1
mix PTQ(int8 & fp16) get error result compare to FP16 by same C++ code

#3975 renshujiajia opened 1 hour ago
2
If the message turns out to be larger than 2147483647 bytes

#3974 lix19937 closed 1 day ago
1
ICudaEngine API error

#3973 hch-baobei opened 3 days ago
0
Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}.

#3972 sushe2111 opened 4 days ago
1
Question about TensorRT 8.6

#3971 Jsy0220 closed 9 hours ago
5
Question about container image

#3970 geraldstanje opened 4 days ago
0
GEMM failure of TensorRT 10.X when running Segment Anything Model on GPU 3090

#3969 summelon opened 5 days ago
4
The yolov5 model has an error in the detection result of tensorrt7.1

#3968 Monlter opened 5 days ago
7
Concurrent inference failure of TensorRT 8.6.1 when running open_clip visual model tensorrt engine on GPU A100

#3967 AmazDeng opened 5 days ago
3
Working with Dynamic Batches the output is always fixed

#3966 vilsonrodrigues closed 3 days ago
3
How do you use" build_engine"?

#3965 kimsoomin415 opened 6 days ago
1
TRT Unet support for Juggernaut ?

#3964 ChuRuaNh0 opened 6 days ago
4
Does TensorRT have plugin for onnx's DynamicQuantizeLinear?

#3963 myunuro opened 6 days ago
3
TensorRT 10 slower than TensorRT 8.6 for models with Instance Normalization layers

#3962 david-PHR opened 6 days ago
4
对Yolov8n.pt转wts后，再序列化构建时，addResize()函数返回值为空，应如何解决？

#3961 retioa11 opened 1 week ago
6
The results are different with or without a printf function call in cuda kernel ?

#3960 lix19937 closed 5 days ago
1
int8/uint8/bool as input not support in trt plugin ?

#3959 lix19937 opened 1 week ago
6
ERROR: root:Exporting to ONNX failed

#3958 dezorianguy opened 1 week ago
1
getOutputDataType understand

#3957 lix19937 closed 1 week ago
1
Engine build failure "cuda misaligned address" of TensorRT 10.1 when running fp16 group normalization with particular value of `num_groups`

#3956 haijieg opened 1 week ago
4
Install Question

#3955 ZeroLelouch1205 opened 1 week ago
1
TensorRT 10.1 and TensorRT 8.6 api update

#3954 hch-baobei closed 1 week ago
3
buildSerializedNetwork failure of TensorRT 10.1 on GPU A10G/3070 - `Error Code 2: Internal Error (Assertion mConfig.caskKlibMapPtr failed. )`

#3953 shingjan opened 1 week ago
1
TensorRT model always return NaN output

#3952 OctaAIVision opened 1 week ago
1
how to use use_int8_scale_max in bertQKVToContextPlugin?

#3951 Andy0422 closed 5 days ago
1
GroupNormalization plugin failure of TensorRT 10.0.1.6 when running trtexec on GPU A4000

#3950 appearancefnp opened 1 week ago
7
TensorRT OSS 10.1 GA Release

#3949 akhilg-nv closed 1 week ago
0
api failure of TensorRT 10.0.1.6 when running trt_infer on GPU any

#3948 hch-baobei closed 1 week ago
3
Will IP Adapter be supported in near future?

#3947 Sundragon1993 opened 2 weeks ago
1
No me permite instalar TENSORrt

#3946 MAFLIXD opened 2 weeks ago
2
Installing tensorrt 10.0.1 pypi package installs wrong version of tensorrt-cu12

#3945 pharmapsychotic opened 2 weeks ago
3
ideas

#3944 Abidouz opened 2 weeks ago
2
chore: update cuda.py

#3943 eltociear opened 2 weeks ago
0
Add Stable Diffusion 3 Demo

#3942 asfiyab-nvidia closed 2 weeks ago
0
In trt10.0.1, these two APIs: setPrecision and setOutputType do not work

#3941 2730gf opened 2 weeks ago
6
Segment Fault of TensorRT 10.0.1 when parsing ONNX model

#3940 plommon closed 1 week ago
7
SD3 scripts and compatibility missing from release/sd3 branch

#3939 lxe closed 2 weeks ago
7
output result error of TensorRT 10.0.1.6 when running conv+clip structure on GPU NVIDIA L4

#3938 yikox opened 2 weeks ago
1
Error when creating TRT engine with INT8 calibration

#3937 labderrafie opened 2 weeks ago
1
pip install results in ModuleNotFoundError

#3936 coppock closed 2 weeks ago
2
TensorRT cannot support Add, creator: Plugin not found, are the plugin name, version, and namespace correct?

#3935 demuxin opened 2 weeks ago
1
the onnx from torch.onnx.dynamo_export not support by trt8.6/trt9.0 ?

#3934 lix19937 closed 2 weeks ago
1
Why TensorRT 8.5 and TensorRT 8.6 do not support dynamic shape input during the calibration?

#3933 yjiangling opened 2 weeks ago
10
Detectron2 - no detections below 832x832 in trt, onnxruntime versions detect correctly

#3932 Huxwell opened 3 weeks ago
2
Inference example for latest tensorrt 10.1

#3931 aliencaocao closed 2 weeks ago
2
A Simple Engine Build Fail on TensorRT 8.6

#3930 Aktcob opened 3 weeks ago
4
how to create TensorRT Run time for two inputs model and one output

#3929 faizan1234567 opened 3 weeks ago
7
Facing "AttributeError: 'tensorrt.tensorrt.INetworkDefinition' object has no attribute 'has_explicit_precision'" when calibrating int8 engine with Polygraphy

#3928 Justin020718 closed 2 weeks ago
3
the link of smapleint8api is invalid

#3927 yehu3d opened 3 weeks ago
1