How can I visualize what Jetson is thinking?

NVIDIA-AI-IOT / redtail

Perception and AI components for autonomous mobile robotics.

BSD 3-Clause "New" or "Revised" License

1.01k stars 344 forks source link

How can I visualize what Jetson is thinking? #10

Closed william-kerr closed 7 years ago

william-kerr commented 7 years ago

Around 36 seconds into this YouTube Video, you can see green, yellow and red shading on top of the video feed. How would I go about replicating that? I'm using gstreamer on my laptop to watch what the drone sees, and have the TrailNet DNN node running. Were you able to see that in real time, or did you apply that effect after the flight was over?

Alexey-Kamenev commented 7 years ago

I have added some details in our wiki. We haven't shared the deconvnet and scripts that we used to create visualizations as they were not exactly easy to use. DIGITS visualization feature described in our wiki allows for good enough debugging so we decided not to bother. We did the post-processing offline as TensorRT did not support deconv layers at that time (it does support it now) but in theory it should be able to run online (though now you would be potentially running 3 DNNs on a Jetson).