leggedrobotics / darknet_ros

YOLO ROS: Real-Time Object Detection for ROS
BSD 3-Clause "New" or "Revised" License
2.23k stars 1.19k forks source link

Frame rate #51

Closed pnambiar closed 6 years ago

pnambiar commented 6 years ago

Did anyone try using the devel branch on TX2. What is the frame rate you are getting for yolo and tiny_yolo model?

mbjelonic commented 6 years ago

I tried one on my tx2 and it was over 10 Hz. It is still a development branch and it does not include all features yet. I will finalize the branch soon. It would be nice if other people test it on their system for comparison.

pnambiar commented 6 years ago

Thanks very much! I will implement it on our TX2. You package has been very useful for our project. Just that we need to get it running at a reasonably good frame rate. Thanks again

mbjelonic commented 6 years ago

I happy that you are able to use it! Do not run it over ssh. Currently I did not add the automatic recognition if X11 is running on the branch.

pnambiar commented 6 years ago

ok. Thanks . Eventually we need to run it on multiple machines.

pnambiar commented 6 years ago

@mbjelonic tiny-yolo @ about 6 fps on TX2. Did you make any changes to settings to run at 10 fps?

pnambiar commented 6 years ago

@mbjelonic Also, when will you be adding the capability to run over ssh?

mbjelonic commented 6 years ago

I will add this early next week.

On 29 Dec 2017, at 20:08, pnambiar notifications@github.com wrote:

@mbjelonic Also, when will you be adding the capability to run over ssh?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

pnambiar commented 6 years ago

@mbjelonic Thank you! Any idea why I'm not getting 10 fps?

ddle commented 6 years ago

@pnambiar did you try running ~/jetson_clocks.sh before darknet? @mbjelonic with devel/threads code I got 15-17fps for tiny-yolo, but only ~3fps for yolo, oddly.

ddle commented 6 years ago

I realize the height and width in yolo.cfg are 608x608 instead of 416x416 which makes the difference. Changed to 416 gives me 5-6fps

mbjelonic commented 6 years ago

@pnambiar I added the possibility to run devel/threads over ssh by adding a check if X11 is running or not. Anyway the branch is still under development and the publishers are not running yet. However, you can check the terminal now over ssh if it is running

pnambiar commented 6 years ago

@mbjelonic Thanks very much. Will test it. @ddle I will try that

DanLiu0623 commented 6 years ago

@pnambiar I try it on TX2, I got 20fps use tiny-yolo only with darknet,but when I use darknet_ros,I only got 8fps,I receive the image from usb_cam.Do you have any idea of my issue?

mbjelonic commented 6 years ago

@DanLiu0623 : Did you test with the devel/threads branch? I achieved higher performance there but I still need to integrate all the ros publishers before I can merge the branch.

pnambiar commented 6 years ago

@mbjelonic I was able to run devel/threads over ssh successfully today. But the topics /darknet_ros/bounding_boxes and /darknet_ros/detection_images does not publish any data.

pnambiar commented 6 years ago

@ddle What is the resolution of the image you are running it on ( for 15-17 fps ) ?

mbjelonic commented 6 years ago

I had to restructure the code a lot in order to achieve the frame rate. I have to add the ros publishers again and also make sure that this is thread safe. On the branch devel/threads the reading and detection of the images are on two different threads now. I just need some time to cleanup everything.

pnambiar commented 6 years ago

@mbjelonic Please let me know as soon as you merge the threads. Thanks

marvrez commented 6 years ago

Hi @mbjelonic, I also got to test the devel/threads branch. When using the master branch I get 2-5fps on a TX2, but when using the devel/threads branch I get the same fps I usually would get only using the darknet framework, which is around 15-20fps. I was able to view the images through darknet's OpenCV viewer, but there were not any outputs from the ROS publishers. When will the ROS publishers be added?

pnambiar commented 6 years ago

@marvrez Were you able to get 15-20 fps with darknet_ros (tiny yolo) ? What is the resolution of your feed?

marvrez commented 6 years ago

@pnambiar I got 15-20fps using the devel/threads branch in darknet_ros feeding in 416x416 pictures.

pnambiar commented 6 years ago

@marvrez Thanks .

ddle commented 6 years ago

@pnambiar I got 17fps with 416x416 in tiny-yolo.cfg and input 854x480 images

mbjelonic commented 6 years ago

Merged the branch devel/threads.

pnambiar commented 6 years ago

Awesome! Thank you