NVIDIA TensorRT issues - Githubissues

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

https://developer.nvidia.com/tensorrt

Apache License 2.0

10.85k stars 2.14k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

error in ms_deformable_im2col_cuda: invalid configuration argument

#4260 nainaigetuide opened 15 hours ago
1
The trt model is used on different graphics cards

#4259 wahaha opened 2 days ago
3
Cuda Runtime (out of memory) failure of TensorRT 10.3.0 when running trtexec on GPU RTX4060/jetson/etc

#4258 zargooshifar opened 3 days ago
1
[ONNXParser] TensorRT Fails to Load ONNX Checkpoints with Separated Weight and Bias Files

#4257 theanh-ktmt opened 3 days ago
0
Polygraphy: how to compare the precision layer by layer with TensorRT if I have a custom operator in my onnx (and a corresponding plugin in TensorRT)?

#4256 MyraYu2022 opened 3 days ago
2
Error Code 10: Internal Error (Could not find any implementation for node failure of TensorRT 8.5 when running on GPU Jetson Xavier NX

#4255 fettahyildizz opened 5 days ago
5
User allocator error allocating 86114304000-byte buffer failure of TensorRT 10.6 when running demo_img2vid. py on GPU rtx4090

#4254 kolyh opened 6 days ago
3
!config.getFlag(BuilderFlag::kFP16). ) failure of TensorRT 10.6 when running demo_txt2img_flux.py on GPU h20

#4253 yja1 opened 6 days ago
0
[Request Request] SetTensorAddress for plugin's input/outputs

#4252 tp-nan closed 6 days ago
1
Linux env TRT_LIBPATH in wrong format when building TensorRT 10.6 OSS

#4251 Synapsess opened 1 week ago
0
Different output with same input between dynamic and static shape model

#4250 smarttowel opened 1 week ago
4
trt-engine-explorer plot circle in graph of an model engine

#4249 roachsinai opened 1 week ago
6
Non-Maximal-Suppression (NMS) Layers slow on TensorRT 10.0-10.6

#4248 darrin-willis opened 1 week ago
2
dynamic shape with stepsize

#4247 linkedqueue closed 1 week ago
2
The latency difference between bilinear gridsample and nearest is significant in the same onnx model

#4246 DaZhUUU opened 1 week ago
6
Feature/apt 3251 perception package

#4245 psilar closed 1 week ago
0
TopK 3840 limitation and future plans for this operator

#4244 amadeuszsz opened 2 weeks ago
1
Optimization of fast-reid infernce using tensorrt

#4243 smrutiranjanmohapatra opened 2 weeks ago
3
How to quantize Linear/LN/ReLU-like structures with int8.

#4242 WeixiangXu opened 2 weeks ago
5
How can I optimize multi-batch and parallel inference in TensorRT for faster performance on high-resolution image patches?

#4241 Nizam-Drongo-Space opened 2 weeks ago
2
RuntimeError: Failed to parse onnx

#4240 wahaha opened 2 weeks ago
2
TensorRT 8.6.1 engine file inference error.

#4239 100daggers closed 2 weeks ago
1
TensorRT 10.6-GA OSS Release

#4238 kevinch-nv closed 2 weeks ago
0
Flux+controlnet

#4237 algorithmconquer opened 2 weeks ago
1
how to analyze the performance of each operator（myelin）?

#4236 cychen3 opened 2 weeks ago
3
How to convert model.onnx and model.onnx_data to trt model

#4235 Sdamuu closed 2 weeks ago
2
State of affairs for NestedTensor (NJT) inference?

#4234 vadimkantorov opened 3 weeks ago
5
Given an engine file, how to know what GPU model it is generated on?

#4233 yangdong02 opened 3 weeks ago
6
How to remove signal and wait layer in the engine?

#4232 lijinghaooo opened 3 weeks ago
5
Tensor Parallel and Context Parallel

#4231 algorithmconquer opened 3 weeks ago
2
Optimize Dynamic Shape Inference for TTS Model with HiFi-GAN Vocoder

#4230 UmerrAhsan opened 3 weeks ago
1
Global tensors with dynamic slice using python

#4229 zengrh3 opened 3 weeks ago
1
Engine built failure of TensorRT 10.5 when running kSTRONGLY_TYPED model on GPU A10

#4228 tp-nan closed 3 weeks ago
3
The results from global tensors slicing are different from creating tensors for each inference

#4227 OswaldoBornemann closed 3 weeks ago
1
How to support referenceNet+unet?

#4226 songh11 opened 3 weeks ago
1
How to force layernorm to run at FP32 precision using python

#4225 OswaldoBornemann closed 4 weeks ago
6
Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::enqueueV3::2666, condition: mContext.profileObliviousBindings.at(profileObliviousIndex) || getPtrOrNull(mOutputAllocators, profileObliviousIndex))

#4224 fgias opened 1 month ago
10
TensorRT 10.5 Flux-dev torch.float16 precision

#4223 algorithmconquer opened 1 month ago
1
Segment error occurred while using plugin

#4222 Beatlesso closed 3 weeks ago
6
bf16 convert failed

#4221 cillayue opened 1 month ago
9
BertQA sample throws segementation fault (TensorRT 10.3) when running GPU Jetson Orin Nano

#4220 krishnarajk opened 1 month ago
8
Can TensorRT calculate the number of Params and FLOPs for the model?

#4219 demuxin opened 1 month ago
8
Questions about polygraphy convertsion

#4218 EmmaThompson123 closed 3 weeks ago
4
could not find any supported formats consistent with input/output data types failure of TensorRT 10.3 on jetson orin

#4217 nainaigetuide opened 1 month ago
2
AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'num_bindings'

#4216 metehanozdeniz opened 1 month ago
2
TensorRT 10.5 Flux Dit BF16 precision

#4215 QZH-eng opened 1 month ago
5
out of memory failure of TensorRT 10.5 when running flux dit on GPU L40S

#4214 QZH-eng opened 1 month ago
5
Failed to pip install TensorRT 10.5.0

#4213 NevermindNilas closed 1 month ago
5
stable diffusion quantization in inpainting task is poor

#4212 worhar opened 1 month ago
3
How to strictly limiting the maximum GPU memory usage and clear GPU memory cache?

#4211 EmmaThompson123 opened 1 month ago
3