mkabra
commented
6 years ago Related to this, any thoughts how can we show confidence/scores for the predictions?
On Wed, Mar 7, 2018 at 4:10 AM Allen Lee notifications@github.com wrote:
Idea is an automated confidence/suspiciousness measure for CPR tracking results. For data where the base tracking is pretty good, the replicate dispersion tends to be higher for more inaccurate frames as intuitively makes sense. In addition to this one can add a trajectory smoothness constraint. Combining these two factors might net a decent warning indicator about the tracking looking "pretty wrong" or "pretty right" at certain frames.
Besides as a general check for tracking performance, two possible usages for training data augmentation: i) APT suggests "this frame looks suspicious" to user for (re)labeling. Intuitively it seems that targeted labeling/augmentation in this way would be incrementally better than augmentation by labeling frames randomly. ii) APT suggests "this frame is probably right" to user for easy/rapid acceptance. Here the idea is that "verification is easier than labeling from scratch" which seems plausible esp when there are a larger number of landmarks.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kristinbranson/APT/issues/185, or mute the thread https://github.com/notifications/unsubscribe-auth/ABLVY0R4Qn-4YLj58YMfPHEynBxDe84uks5tbxBNgaJpZM4Sfjz1 .
allenleetc
arobie
Idea is an automated confidence/suspiciousness measure for CPR tracking results. For data where the base tracking is pretty good, the replicate dispersion tends to be higher for more inaccurate frames as intuitively makes sense. In addition to this one can add a trajectory smoothness constraint. Combining these two factors might net a decent warning indicator about the tracking looking "pretty wrong" or "pretty right" at any given time.
Besides as a general check for tracking performance, two possible usages for training data augmentation: i) APT suggests "this frame looks suspicious" to user for (re)labeling. Intuitively it seems that targeted labeling/augmentation in this way would be incrementally better than augmentation by labeling frames randomly. Note the "Suspicious Frames" fcnality already exists but that is currently based on traj smoothness only. ii) APT suggests "this frame is probably right" to user for easy/rapid acceptance. Here the idea is that "verification is easier than labeling from scratch" which seems plausible esp when the number of landmarks is larger.