icatcherplus / icatcher_plus

iCatcher+: Robust and automated annotation of infant gaze from videos collected in laboratory, field, and online studies
GNU General Public License v3.0
17 stars 19 forks source link

Illegal transitions correction fails when noface or nobaby face is replaced with left, right or away #34

Closed GalRaz closed 1 year ago

GalRaz commented 1 year ago

example video shared securely.

yoterel commented 1 year ago

Just to give context, illegal transitions is an option for post-processing results from icatcher, which forces the output to conform with certain human made rules. For example a user might want to swap any transition such as "left, right, left" with "left, left, left", since it might be physically impossible to transition that quickly from left to right.

The naive way to solve would be the perform a 2nd pass over the full output, and fixing all user defined illegal transition rules.

The current implementation does not do this, but rather buffers the output and replaces illegal transitions on the fly. The reason swapping any negative classes (no face) with positive ones fail is we don't currently update the bounding boxes used for visualization, so if someone wants to see the result or save to disk an output video it fails.

yoterel commented 1 year ago

fixed with #37