search

pgodb / Peak-CNN

1 stars 1 forks source link

interest from OpenPTV #1

Open alexlib opened 1 month ago

alexlib commented 1 month ago

Dear @pgodb - we'd be very interested in running your CNN with OpenPTV. Please let's discuss the best way to incorporate it. Alex

pgodb commented 3 weeks ago

Dear Alex, thanks for your interest. Unfortunately it will take a bit longer for me to upload code as the person approving these things is away on projects quite a lot at the moment.

What I have prepared and plan to upload is a python implementation using tensorflow and numpy together with a little Jupyter notebook that implements a small test case. The function to apply the peak detector accepts an image as numpy array and outputs the found peaks as numpy array so should be quite easy to integrate.

The training code besides the images needs 2d ground truth peak positions as input. If these are taken from 3d Tracking data or synthetic positions one would need to call some kind of „world2cam“ function from the respective camera model. Or, if the simpler approach using stacked peak detections is to be used one would need to call ones choice of peak detector on several images and add them together.

The code should be complete enough that it will be mostly a question of shoveling the right data through the interface, something that is probably best done by someone with expertise in the respective tracking codebase this is going to be integrated into.

Philipp