search

dnum-mi / basegun

Web app for identifying a firearm based on a picture
https://basegun.interieur.gouv.fr/
Eclipse Public License 2.0
13 stars 0 forks source link

Define a treshold for the card detection #431

Closed ClemGerard closed 1 month ago

ClemGerard commented 2 months ago

Définir un seuil de détection de carte en dessous duquel on considère qu'il n'y a pas de carte présente sur la photo, et donc que l'on affiche l'écran de rappel d'ajout d'une photo (missing card).

ClemGerard commented 2 months ago

test sur le dataset de l'IRCGN

Attention étiquette de saisie /!\ : confusion plus que plausible entre la carte pour la mesure et la carte de saisie.

AurelienmartW commented 2 months ago

First analysis: 0.5 seems to be a good threshold for card detection. Further analysis on S3 bucket basegun will give a more precise threshold

AurelienmartW commented 2 months ago

Image

Study on confidence score threshold for card detection.

card data -> 100 images of weapons with card Nocard data -> 100 images of weapons without cards

Using a 0.5 thresholds for the confidence threshold of card detection: 81% of false positive removed 94% of true positive remained

Disclaimer -> those statistics are performed on particular datasets and not real basegun images from the app. Another study should be realized in order to obtain a more precise threshold