Track multiple points

[OLGKAD]

The system is already reasonably good at tracking a single point of interest. Now it needs to be extended to track multiple points of interest. I propose the following design:

1. User experience. In the first frame, the user marks several points. Once the video is processed, the user goes through all the frames to see if any of the points was mistracked in any of the frames. If there's a rectangle (or a circle - whatever shape I use to mark points) is mislocated in some frame, how to know which of the points it was supposed to mark?

• Maybe they should be leaving a trace (trajectory) behind them.

• Maybe just build the system good enough so that no two points are mislocated at the same time. That's not a robust solution though.

• They could have different colours.

Besides, when marking the mislocated point, the system should know what rectangle (circle) we're trying to move to a different position. The best solution seems to be to make all the rectangles draggable. Implementing this, and assigning different colours to each mark should be enough.

2. Implementation. ... to be figured out

[OLGKAD]

OpenCV is clearly not designed to handle such complex GUI interactions. Maybe it's time to try integrating the code into a Unity3D app.