search

Azure-Samples / NVIDIA-Deepstream-Azure-IoT-Edge-on-a-NVIDIA-Jetson-Nano

This is a sample showing how to do real-time video analytics with NVIDIA DeepStream connected to Azure via Azure IoT Edge. It uses a NVIDIA Jetson Nano device that can process up to 8 real-time video streams concurrently.
MIT License
172 stars 56 forks source link

Nvidia Deepstream SDK module runtime backoff with Exit Code 255 #12

Closed leela-uppuluri closed 3 years ago

leela-uppuluri commented 4 years ago

I was trying to run Nvidia Deepstream SDK example. But when I was trying to run Deepstream to output the inferred videos to an RTSP video stream and visualize this RTSP stream with VLC, I am running into Exit Code 255 error and the runtime status shows backoff. I was trying to run same steps that was mentioned in the ReadMe file but don't understand why the Deepstream SDK module doesn't work.

Here's the snapshot of my deployed Azure IoT Edge resources,

img-1

Zvikas1 commented 4 years ago

Hi ,

I am also having the same problem , after deploying Deepstream sdk status goes to "backoff" then "failed" , i will be glad to help

leela-uppuluri commented 4 years ago

Hi Vikas,

Thanks for your response, I tried to check the logs of Deepstream SDK module to see why it is failing and found it is looking for some config file I think but for some reason it shows "No such file or directory" error. I was following the same steps mentioned in the ReadMe file but the small change on my end was, I'm trying to do this experiment using Deepstream SDK 4.0.2 for x86 because I'm conducting this experiment on data-center GPUs. Attached is the snapshot of logs I was talking about,

Screenshot from 2020-03-30 00-34-30

leela-uppuluri commented 4 years ago

@Zvikas1 Do you have any suggestions on the above comment?

Zvikas1 commented 4 years ago

@leela-uppuluri ,

I was trying to understand , have you succeeded in deploying the SDKDeepstream Module ? Cause mine are failing after 30 sec . Are you running in your snapshot the logs of the test5 app example from the nano ? Which logs are you looking at ? Can you elaborate please?

leela-uppuluri commented 4 years ago

@Zvikas1 I could able to successfully deploy Deepstream SDK module but I see the module is going under "backoff" status after few mins it is deployed. I tried running this module on bare metal IoT Edge device server attached with data center GPU (Nvidia T4). I am looking at the logs on visual studio code using the option "Start Monitoring Built-in Endpoint" on IoT Hub and I am checking this logs right after the SDK module was deployed.

leela-uppuluri commented 4 years ago

@Zvikas1 Does the above comment helps?

emmanuel-bv commented 3 years ago

Sorry for the delay. Correct this issue was because of a version mismatch. This sample has been updated with jetpack 4.5 and DeepStream 5.1, so it should go away with when using this version.