metazool
commented
1 month ago Searching an aerial photo with text queries – a demo and how it works - lovely blog writeup about the potential inherent in this approach, in this case doing text search from embeddings with a model called SkyCLIP that's fine-tuned on remote sensing imagery
BioCLIP is a foundation model designed for classification of all or parts of biological images of all kinds, it could also be a useful source of embeddings that would generalise to a few projects
Aiming at running BioCLIP for the same outcome as #5 could be a great exercise for our regular pair programming session @albags ?