Image similarity demo with ImageBind - Githubissues

yoohj0416 / NLSearch

Apache License 2.0

0 stars 0 forks source link

Image similarity demo with ImageBind #3

Open yoohj0416 opened 10 months ago

yoohj0416 commented 10 months ago

I made image similartiy demo code with ImageBind.

Comparing image similiartiy between ImageBind and CLIP

ImageBind CLIP

ImageBind exhibits a stronger cosine similarity than CLIP.

Comparing zero-shot classification results between ImageBind and CLIP

ImageBind CLIP

In a image of both horse and bus, unlike CLIP, ImageBind shows a significantly higher probability for 'bus'.
ImageBind successfully classify cat image with a low probability. However, this is of the use of CenterCrop in the preprocessing step in CLIP. (ImageBind just uses Resize)

ImageBind similarity demo code: demo.py