search

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
https://developer.nvidia.com/tensorrt
Apache License 2.0
10.84k stars 2.14k forks source link

Unable to Launch the TensorRT-OSS build container #4139

Open krishnarajk opened 2 months ago

krishnarajk commented 2 months ago

Description

I am trying to follow the steps here https://github.com/NVIDIA/TensorRT/blob/release/8.6/README.md and lauch the tensorrt oss. I am getting the below issue

`sudo ./launch.sh --tag tensorrt-aarch64-ubuntu20.04-cuda12.2
Launching container:

docker run --gpus all -v /home/vwif/TensorRT/docker:/workspace/TensorRT --rm -it tensorrt-aarch64-ubuntu20.04-cuda12.2:latest docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'csv' invoking the NVIDIA Container Runtime Hook directly (e.g. specifying the docker --gpus flag) is not supported. Please use the NVIDIA Container Runtime (e.g. specify the --runtime=nvidia flag) instead.: unknown. `

Environment

TensorRT Version: 8.6

NVIDIA GPU: Jetson Orin Nano

CUDA Version: 12.2

lix19937 commented 2 months ago

Try to add '--runtime=nvidia' in your docker run cmd. @krishnarajk