DCS-LCSR / ASL-DAI

1 stars 0 forks source link

Tracking performance of sign recognition - once this goes public #430

Closed cneidle closed 2 months ago

cneidle commented 1 year ago

One other thing we should discuss at some point, is something we discussed a while back: some way of tracking the success of our sign recognition. We talked about tracking, e.g.

Target sign (as confirmed by user) - signs proposed as 1st, 2nd, 3rd, 4th, and 5th most likely for that sign.

We are not retaining the videos, so we won’t get useful information about the ones that are totally missed, but we should also keep track of how many of those there are.

We might want to exclude counts for when we are logged in, so our own work doesn’t skew those statistics.

Just some thoughts.

We can discuss at some point before this goes live.

Thank you !!