search

blissd / fotema

Photo gallery for Linux
81 stars 8 forks source link

Similarity search feature #214

Open NelvinBHV opened 1 month ago

NelvinBHV commented 1 month ago

I would be pleased if fotema could receive a similarity search feature. Similar images and videos could then be grouped by keywords, such as mountains, beach, etc. It seems that OpenCV already offers this functionality.

blissd commented 1 month ago

Hi @NelvinBHV. Yes, I'd very much like a feature like this. I've looked into the Hugging Face Candle options for similar features to this and think it could be a candidate (thought it is more object detection, than scene detection).

NelvinBHV commented 1 month ago

I'm glad to hear that! I'm looking forward to seeing your implementation. Personally, I would prefer OpenCV since you've already integrated it for facial recognition.

blissd commented 1 month ago

I think OpenCV is a good library, and without it I think I would have found person recognition much harder to implement. But... I would really like the libraries used by Fotema to be native Rust, rather than C++. My reason for this is reliability, as I've already experienced some crashes from other C/C++ libraries that Fotema uses through Rust bindings.

Having said that, I initially tried to use the Hugging Face Candle libraries for the face recognition and person recognition feature... but I found it too low level and complicated to easily work with :disappointed:, so OpenCV might be the solution after all.