search

roboflow / notebooks

Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.
https://roboflow.com/models
4.78k stars 744 forks source link

Add CLIP search notebook #204

Closed capjamesg closed 9 months ago

capjamesg commented 9 months ago

This PR adds the CLIP search notebook used in our How to Build an Image-to-Image Search Engine with CLIP and Faiss tutorial to Notebooks.

SkalskiP commented 9 months ago

@capjamesg Just a small question: don't we have CLIP search already in our notebooks: https://colab.research.google.com/github/roboflow-ai/notebooks/blob/main/notebooks/image_embeddings_analysis_part_1.ipynb

Take a look at the Search most similar images section. I'm a bit confused about our strategy for the notebooks repository.

capjamesg commented 9 months ago

When we write a purpose-built notebook for a blog post, I think it should live here.

The blog post referenced is exclusively about CLIP search, not the other properties of embeddings. It is for a different audience. Someone looking at the embedding analysis notebook is in the mindset of "I want to learn more about embeddings" or "I am curious about embeddings" whereas the CLIP search notebook is "I want to build a search engine."