menpo / landmarker.io

Image and mesh annotation web application
https://www.landmarker.io
BSD 3-Clause "New" or "Revised" License
114 stars 21 forks source link

Think about video annotation #130

Open jabooth opened 8 years ago

jabooth commented 8 years ago

Actually looks like it might be possible.

http://inconduit.com/smpte/

https://stemkoski.github.io/Three.js/Video.html

markosgeo commented 7 years ago

Here is what I had in mind for the video bounding-box annotations.

It should accept video input and be able to play it (like a player, non just frame by frame). Also, it should be able to handle bounding box annotation, which should be hand-annotated on some frames and then interpolated for the rest of the frames.

Something like this: https://www.youtube.com/watch?v=ljI5pAowACc

I think we should use a square bounding box, which should be annotated by marking two points or even better, by marking the nose-tip and the changing the scale.

Last but not least, it would be awesome if it could use already annotated videos (with bounding boxes from a tracker), so that the annotator can change the dimension and position of the bounding box and correct the errors of the face-tracker. These corrections should be interpolated to the other frames as well

What do you think?