search

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
https://developer.nvidia.com/tensorrt
Apache License 2.0
10.78k stars 2.13k forks source link

XXX failure of TensorRT X.Y when running XXX on GPU XXX #4103

Open eraykstrl opened 2 months ago

eraykstrl commented 2 months ago

Description

I get this this issue [08/31/2024-21:29:05] [TRT] [I] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +6, GPU +64, now:

Environment

TensorRT Version:8.5.2.2

NVIDIA GPU:Orin NX

NVIDIA Driver Version:

CUDA Version:11.4

CUDNN Version:

Operating System:Jetpack 5.1.2

Python Version (if applicable): 3.8 Tensorflow Version (if applicable):

PyTorch Version (if applicable):

Baremetal or Container (if so, version):

Relevant Files

Model link:

Steps To Reproduce

Commands or scripts:

Have you tried the latest release?:

Can this model run on other frameworks? For example run ONNX model with ONNXRuntime (polygraphy run <model.onnx> --onnxrt):

moraxu commented 2 months ago

Hi, I think your error message got clipped by accident?

lix19937 commented 2 months ago

No useful information available.