Image similarity search demo with CLIP - Githubissues

yoohj0416 / NLSearch

Apache License 2.0

0 stars 0 forks source link

Image similarity search demo with CLIP #2

Open yoohj0416 opened 10 months ago

yoohj0416 commented 10 months ago

I made image similarity search demo code in colab. link: Image_similarity_search_demo_with_CLIP.ipynb

I implemented two type of similarity search demo:

text query search
image query search

issues

The model failed to classify cat image, whose id is 3440089012_0e580cecc7_z, on zero-shot classification.
Image search by text query with 'cat' is also failed.
Image search by text query with 'decorations' is success.
In image query search, 3 of 4 images show high score with cat image which is in top-3. However, I cannot realize similarities between them.