dora-rs / dora-drives

A step-by-step tutorial that allows beginners to write their own autonomous vehicle program from scratch using a simple starter kit. Dora-drives makes learning autonomous vehicle systems faster and easier.
https://www.dora-rs.ai/docs/guides/dora-drives/
Apache License 2.0
48 stars 11 forks source link

add operator -> MiDaS computes relative inverse depth from a single i… #55

Closed meua closed 1 year ago

meua commented 1 year ago

add MiDaS models for computing relative depth from a single image. from https://pytorch.org/hub/intelisl_midas_v2/

haixuanTao commented 1 year ago

Can you provide a way to run this PR as well as details about the expected outputs?

meua commented 1 year ago

Can you provide a way to run this PR as well as details about the expected outputs?

Yes, Here are the steps to run this instance: Steps to produce the behavior:

  1. Dora start daemon: dora up
  2. Start a new dataflow: dora start graphs/tutorials/webcam_single_dpt_frame.yaml --attach --hot-reload --name dpt_midas

Screenshots or Video image

haixuanTao commented 1 year ago

Depth Frame are very visual outputs. In the best of my capabilities, I can't picture float matrix in my mind as you screenshotted. Would it be possible for you to export the depth_frame into the plot operator.

I have found an example that you can reuse: https://github.com/IntelRealSense/librealsense/blob/master/wrappers/python/examples/opencv_viewer_example.py

meua commented 1 year ago

Depth Frame are very visual outputs. In the best of my capabilities, I can't picture float matrix in my mind as you screenshotted. Would it be possible for you to export the depth_frame into the plot operator.

I have found an example that you can reuse: https://github.com/IntelRealSense/librealsense/blob/master/wrappers/python/examples/opencv_viewer_example.py

Ok, thanks, I'll try.

meua commented 1 year ago

Depth Frame are very visual outputs. In the best of my capabilities, I can't picture float matrix in my mind as you screenshotted. Would it be possible for you to export the depth_frame into the plot operator.

I have found an example that you can reuse: https://github.com/IntelRealSense/librealsense/blob/master/wrappers/python/examples/opencv_viewer_example.py

image

haixuanTao commented 1 year ago

Good, can you:

haixuanTao commented 1 year ago

General observation: