search

AnswerDotAI / byaldi

Use late-interaction multi-modal models such as ColPali in just a few lines of code.
Apache License 2.0
417 stars 44 forks source link

Support for searching with query image #27

Open nuschandra opened 1 day ago

nuschandra commented 1 day ago

Hi @bclavie & team,

I currently don't see support for searching through an index with a query image instead of a text query. I understand that there is an encode_image option but that only provides the embeddings of the query image and not a full search through the indexed documents along with maxsim calculations. It would be really nice to have support for querying with an image too.

nuschandra commented 18 hours ago

@bclavie If you think that this would be a useful feature, I'd be happy to contribute and raise a PR for the same.