roboflow / roboflow-100-benchmark

Code for replicating Roboflow 100 benchmark results and programmatically downloading benchmark datasets
https://www.rf100.org
MIT License
244 stars 23 forks source link

GLIP: Zero shot analysis #37

Closed FrancescoSaverioZuppichini closed 1 year ago

FrancescoSaverioZuppichini commented 1 year ago

Description

In this PR I've created a new notebook to analyse GLIP results based on its mAP. We discovered (not surprised) that GLIP did very badly when the class names are either non-descriptive (e.g. '0', '1' etc) or where they are very domain specific (e.g. a name of a bacteria)