search

tapis-project / camera-traps

BSD 3-Clause "New" or "Revised" License
5 stars 9 forks source link

Image Score/Store coordination #21

Closed richcar58 closed 1 year ago

richcar58 commented 1 year ago

The output of the image_score_plugin is processed by the image_store_plugin to determine the final disposition of the image and its related data (scores, bounding box images, etc). These two plugins need to coordinate more closely. Specifically, how should the image_store_plugin should interpret multiple probability scores for the same label? Here is an example of such a score:

{"created":"2023-05-08T19:00:27.117198","image_uuid":"cbe2a668-d416-54fe-a3f3-1c51de7ac199","image_format":"JPEG","scores":[{"label":"human","probability":0.00516},{"label":"human","probability":0.00803},{"label":"human","probability":0.009},{"label":"human","probability":0.0132},{"label":"animal","probability":0.0221},{"label":"human","probability":0.0701},{"label":"human","probability":0.0806},{"label":"animal","probability":0.149},{"label":"animal","probability":0.66},{"label":"human","probability":0.7}]}

richcar58 commented 1 year ago

The image_store_plugin looks for the highest probability in the result. We may want to revisit this strategy in the future, but it works for now.