search

obendidi / Tracking-with-darkflow

Real-time people Multitracker using YOLO v2 and deep_sort with tensorflow
GNU General Public License v3.0
523 stars 174 forks source link

Difficulty tracking people with occlusion by tree branches #41

Open masonearles opened 6 years ago

masonearles commented 6 years ago

First off, thanks for combining Darkflow with DeepSort. I'm really enjoying playing around with it.

Generally, I've found the tracking to be pretty successful when there is limited occlusion by other objects. However, I'm trying to track people when there is occlusion by tree branches (see attached screenshot). As a result, I think that Darkflow is having trouble recognizing these as people -- given the strange lines, aka branches, that are randomly oriented across their bodies. I considered finetuning the existing model with images from some of my videos, but I'm getting stuck. How do you recommend dealing with this issue?

Thanks for any direction!

screenshot from 2018-02-19 11-04-16

obendidi commented 6 years ago

you could try adding optical flow , with opencv , it works well with occlusions : https://github.com/akshaychawla/Optical-Flow-Tracking----OpenCV

i'm working on another version of this project with support for multiple object Detectors (Detectron/object detection API, darkflow ) , and multiple tracking algorithms , so that it will be easier to test and find best combinaison

masonearles commented 6 years ago

Thanks for your suggestion. I've been working on testing out optical flow, but am having trouble understanding how to integrate it with your existing code. Can you provide some direction to get me started?